00000001:02000400:2.0F:1789265187.617589:0:2958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789265203.616868:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789265205.162133:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 627 MB/s 00000001:01000000:0.0F:1789265205.412878:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 932 MB/s 00000001:01000000:3.0F:1789265205.664264:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4294 MB/s 00000020:02000000:3.0:1789265206.533392:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_106_gd81f50d 00000400:02000000:1.0F:1789265207.611526:0:3288:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.143@tcp [8/256/0/180] 00008000:02000000:3.0:1789265211.579326:0:3437:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789265261.665389:0:5240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789265273.326243:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265273.326248:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789265273.326595:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d4e2b468 00000080:02000400:2.0:1789265273.326605:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789265273.331881:0:5814:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789265273.331896:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789265273.331937:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000045f1a88a) 00000020:00000080:2.0:1789265273.331956:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789265273.349835:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789265273.350269:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789265273.373254:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789265273.373294:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789265273.373314:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789265273.373397:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789265273.373600:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789265273.375881:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789265273.375891:0:5814:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265273.375902:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef818f103 00000020:01000004:2.0:1789265273.375909:0:5814:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789265273.375914:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789265273.375917:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d4e2b468 from MGS 00000020:01000004:2.0:1789265273.375921:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789265273.375933:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000063c897dc) 00000020:00000080:2.0:1789265273.375943:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789265273.376034:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d4e2b468 from MGS, refs=2 00080000:01000000:2.0:1789265273.376039:0:5814:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265273.376044:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef818f111 00000100:00100000:2.0:1789265273.376148:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789265273.376291:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789265273.376297:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789265273.377148:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789265273.377154:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789265273.378078:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265273.378260:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789265273.378265:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789265273.379128:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789265273.379137:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789265273.379887:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789265273.379896:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789265273.380804:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265273.380807:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265273.380809:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265273.381080:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265273.381083:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265273.381084:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265273.381907:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789265273.395297:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789265273.631891:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2235 MB/s 00000001:01000000:2.0:1789265273.882355:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2059 MB/s 00000001:01000000:1.0:1789265274.132858:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 500 MB/s 00000001:01000000:3.0:1789265274.382509:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 523 MB/s 00080000:10000000:2.0:1789265274.389088:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1789265274.398694:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789265274.408840:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789265274.408859:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789265274.408862:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789265274.409918:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789265274.410148:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789265274.410195:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789265274.411599:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789265274.411637:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789265274.411940:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265274.412125:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789265274.412138:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789265274.415029:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789265274.415046:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789265274.427538:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789265274.427557:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789265274.430109:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789265274.430134:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.143@tcp' 00000020:01000004:1.0:1789265274.430136:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789265274.430230:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.143@tcp (typ=mgc) 00000020:00000080:1.0:1789265274.430256:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.143@tcp (00000000a4bd5984) 00000020:00000080:1.0:1789265274.430282:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789265274.430464:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e4350a11@MGC192.168.204.143@tcp: add connection 192.168.204.143@tcp at head 00010000:00010000:1.0:1789265274.430630:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.143@tcp-0 is initialized 00000040:01000000:1.0:1789265274.430637:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789265274.431122:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789265274.435320:0:5831:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789265274.435473:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.143@tcp (uuid 1c534bc8-3a63-4f3a-b547-3e911eb5da8a) 00000020:00000080:0.0:1789265274.435500:0:5814:0:(genops.c:1385:class_connect()) connect: client 1c534bc8-3a63-4f3a-b547-3e911eb5da8a, cookie 0x8e12577ef818f11f 00000100:00080000:0.0:1789265274.435514:0:5814:0:(import.c:510:import_select_connection()) MGC192.168.204.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265274.435520:0:5814:0:(import.c:624:import_select_connection()) MGC192.168.204.143@tcp: import 00000000e4350a11 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1789265274.435583:0:5814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f305c863 x1876180553695360/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265274.435608:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS 00000100:00100000:1.0:1789265274.436268:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f305c863 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3303:1876180553695360:0@lo:250: 00000100:00100000:1.0:1789265274.436371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265274.439126:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553695360 00000100:00100000:2.0:1789265274.439146:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553695360 00000100:00100000:2.0:1789265274.439192:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265274.439199:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064dba9c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1876180553695360:12345-0@lo:250: 00010000:00080000:2.0:1789265274.439230:0:5825:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1c534bc8-3a63-4f3a-b547-3e911eb5da8a@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:2.0:1789265274.439260:0:5825:0:(genops.c:1385:class_connect()) connect: client 1c534bc8-3a63-4f3a-b547-3e911eb5da8a, cookie 0x8e12577ef818f126 00000100:00080000:2.0:1789265274.439511:0:5825:0:(import.c:65:import_set_state_nolock()) 000000007d2fc64e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265274.439627:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064dba9c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:3303:x1876180553695360:12345-0@lo:250: Request processed in 427us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265274.439635:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265274.440148:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789265274.440159:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.143@tcp: connect to target with instance 0 00000100:00080000:2.0:1789265274.440166:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789265274.440171:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789265274.440173:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000e4350a11 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789265274.440176:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789265274.440185:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789265274.440190:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f305c863 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3303:1876180553695360:0@lo:250: 00000020:01000004:0.0:1789265274.441318:0:5814:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789265274.441329:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789265274.441367:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000026c63f7b) 00000020:00000080:0.0:1789265274.441384:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789265274.463175:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265274.464987:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265274.464999:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789265274.469827:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265274.469844:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789265274.470299:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265274.470305:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789265274.472116:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265274.472308:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789265274.472314:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789265274.474190:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789265274.474202:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789265274.533151:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265274.533493:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789265274.533500:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789265274.535128:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789265274.535140:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789265274.536039:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265274.536225:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265274.536230:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789265274.537063:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265274.537072:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789265274.537866:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265274.538072:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265274.538077:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789265274.538859:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265274.538867:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789265274.539906:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265274.540293:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265274.540300:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789265274.541295:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265274.541305:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789265274.564127:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265274.564724:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265274.564731:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789265274.567268:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265274.567292:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789265274.568996:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265274.569007:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789265274.570900:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789265274.570928:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789265274.570934:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789265274.571078:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789265274.571114:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.143@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789265274.571118:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789265274.571121:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265274.571122:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265274.571123:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265274.571124:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265274.571126:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265274.571127:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265274.571128:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265274.571130:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265274.571131:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265274.571133:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265274.571134:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265274.571140:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789265274.571200:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265274.571202:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265274.571203:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265274.571204:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265274.571204:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265274.571206:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265274.571206:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265274.571207:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265274.571208:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265274.571209:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265274.571210:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265274.571211:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265274.571247:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789265274.571264:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a5c803c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553695488:0@lo:253: 00000100:00100000:0.0:1789265274.571500:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265274.571753:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f68801d going to sleep for 11 seconds 00000100:00100000:1.0:1789265274.572117:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553695488 00000100:00100000:1.0:1789265274.572126:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553695488 00000100:00100000:1.0:1789265274.572216:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265274.572225:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9a62273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:5814:x1876180553695488:12345-0@lo:253: 20000000:01000000:1.0:1789265274.572270:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265274.572275:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789265274.574833:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789265274.574899:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789265274.575232:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265274.577702:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789265274.578009:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265274.578014:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789265274.578020:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789265274.578024:0:5828:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789265274.578040:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789265274.578303:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265274.578849:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789265274.578866:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789265274.578914:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789265274.578973:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789265274.579011:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789265274.579112:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789265274.579120:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789265274.579219:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789265274.579229:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789265274.579260:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789265274.579267:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789265274.579294:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789265274.579493:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789265274.579526:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789265274.579531:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789265274.579542:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265274.579863:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789265274.579876:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789265274.579909:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789265274.579941:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789265274.579999:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789265274.580012:0:5828:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789265274.580082:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789265274.580091:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789265274.580132:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789265274.580269:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789265274.580303:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789265274.580314:0:5828:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789265274.581842:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789265274.581862:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789265274.581897:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789265274.581932:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789265274.582212:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789265274.582262:0:5828:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789265274.582270:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789265274.583080:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789265274.583916:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789265274.583940:0:5828:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.143@tcp for mdt 20000000:01000000:0.0:1789265274.583942:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789265274.583985:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789265274.583992:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789265274.584017:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789265274.584022:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:0.0:1789265274.584057:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789265274.584066:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789265274.584090:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789265274.584116:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789265274.584179:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789265274.584182:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789265274.584188:0:5828:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789265274.584193:0:5828:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789265274.584788:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1789265274.584893:0:5828:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789265274.598020:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789265274.598077:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789265274.599065:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789265274.599089:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789265274.599092:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789265274.599095:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789265274.599135:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789265274.599138:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789265274.599183:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789265274.599186:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789265274.600426:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1789265274.600870:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1789265274.600913:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1789265274.600993:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1789265274.601007:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789265274.601009:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789265274.601468:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789265274.601842:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789265274.601884:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789265274.601917:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789265274.601929:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265274.601932:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1789265274.601939:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789265274.601973:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.601991:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602001:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602007:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602013:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602028:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602034:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe92a43e already unused, calling callback (000000003291cc9e) 00010000:00010000:1.0:1789265274.602038:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602046:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602060:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602066:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265274.602071:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe92a43e/0x8e12577ef818f134 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265274.602090:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789265274.878047:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9a62273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:5814:x1876180553695488:12345-0@lo:253: Request processed in 305816us (306539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.878068:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265274.878182:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a5c803c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553695488:0@lo:253: 10000000:01000000:3.0:1789265274.878198:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789265274.878202:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265274.878204:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265274.878205:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265274.878206:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789265274.878208:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265274.878209:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265274.878211:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265274.878212:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265274.878213:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789265274.878215:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265274.878216:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265274.878237:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d4e2b468 from lustre-MDT0000 10000000:01000000:3.0:1789265274.878275:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789265274.878278:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789265274.878283:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff925402d54d28 10000000:01000000:3.0:1789265274.878289:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265274.878297:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925402d54d28 from 1 10000000:01000000:3.0:1789265274.878300:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789265274.878369:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 000000007e4309ab/0x8e12577ef818f13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265274.878380:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 000000007e4309ab/0x8e12577ef818f13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265274.878390:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 000000007e4309ab/0x8e12577ef818f13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265274.878421:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0499570 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553695616:0@lo:101: 00000100:00100000:3.0:1789265274.878460:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265274.878518:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a6b6622 going to sleep for 11 seconds 00000100:00100000:2.0:1789265274.878725:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553695616 00000100:00100000:2.0:1789265274.878739:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553695616 00000100:00100000:2.0:1789265274.878782:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265274.878789:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3680365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:5814:x1876180553695616:12345-0@lo:101: 00010000:00010000:2.0:1789265274.878802:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265274.878816:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000edef2206/0x8e12577ef818f142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f13b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265274.878839:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edef2206/0x8e12577ef818f142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f13b expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265274.878849:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000edef2206/0x8e12577ef818f142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f13b expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265274.878857:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000edef2206, rc 0) 00000100:00100000:2.0:1789265274.878893:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3680365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+6:5814:x1876180553695616:12345-0@lo:101: Request processed in 105us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265274.878898:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265274.878983:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0499570 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553695616:0@lo:101: 00010000:00010000:0.0:1789265274.878995:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 000000007e4309ab/0x8e12577ef818f13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879003:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 000000007e4309ab/0x8e12577ef818f13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265274.879050:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553695744:0@lo:501: 00000100:00100000:0.0:1789265274.879083:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265274.879107:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4441f5b going to sleep for 11 seconds 00000100:00100000:2.0:1789265274.879161:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553695744 00000100:00100000:2.0:1789265274.879166:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553695744 00000100:00100000:2.0:1789265274.879197:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265274.879204:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000faf4994b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+6:5814:x1876180553695744:12345-0@lo:501: 00000100:00100000:2.0:1789265274.879467:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000faf4994b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+6:5814:x1876180553695744:12345-0@lo:501: Request processed in 263us (383us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265274.879474:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265274.879551:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553695744:0@lo:501: 10000000:01000000:0.0:1789265274.879649:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265274.879663:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 000000007e4309ab/0x8e12577ef818f13b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879671:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 000000007e4309ab/0x8e12577ef818f13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265274.879678:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff925409ebd800 10000000:01000000:0.0:1789265274.879682:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789265274.879686:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff925409ebd800 10000000:01000000:0.0:1789265274.879688:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789265274.879690:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff925409ebd800 from 1 10000000:01000000:0.0:1789265274.879692:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789265274.879710:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 000000007cebdb71/0x8e12577ef818f149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879716:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 000000007cebdb71/0x8e12577ef818f149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879723:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 000000007cebdb71/0x8e12577ef818f149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265274.879734:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553695872:0@lo:101: 00000100:00100000:0.0:1789265274.879758:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265274.879781:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4441f5b going to sleep for 11 seconds 00000100:00100000:0.0:1789265274.879793:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553695872 00000100:00100000:0.0:1789265274.879796:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553695872 00000100:00100000:0.0:1789265274.879817:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265274.879822:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000058aeaf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+6:5814:x1876180553695872:12345-0@lo:101: 00010000:00010000:0.0:1789265274.879835:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265274.879846:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd38bfaa/0x8e12577ef818f150 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f149 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879859:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd38bfaa/0x8e12577ef818f150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f149 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879867:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd38bfaa/0x8e12577ef818f150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f149 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879873:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd38bfaa, rc 0) 00000100:00100000:0.0:1789265274.879898:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000058aeaf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+7:5814:x1876180553695872:12345-0@lo:101: Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.879904:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265274.879933:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553695872:0@lo:101: 00010000:00010000:0.0:1789265274.879942:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 000000007cebdb71/0x8e12577ef818f149 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879949:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 000000007cebdb71/0x8e12577ef818f149 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265274.879972:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789265274.879975:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 000000007cebdb71/0x8e12577ef818f149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.879981:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 000000007cebdb71/0x8e12577ef818f149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265274.879991:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789265274.880000:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265274.880004:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff925409ebd800 10000000:01000000:0.0:1789265274.880006:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789265274.880009:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789265274.880011:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265274.880023:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 000000006e80fbc9/0x8e12577ef818f157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.880030:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 000000006e80fbc9/0x8e12577ef818f157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.880036:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 000000006e80fbc9/0x8e12577ef818f157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265274.880047:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696000:0@lo:101: 00000100:00100000:0.0:1789265274.880068:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265274.880080:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056f4fb66 going to sleep for 11 seconds 00000100:00100000:0.0:1789265274.880092:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553696000 00000100:00100000:0.0:1789265274.880095:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553696000 00000100:00100000:0.0:1789265274.880111:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265274.880115:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d73fa3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+7:5814:x1876180553696000:12345-0@lo:101: 00010000:00010000:0.0:1789265274.880121:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265274.880127:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8a2db01/0x8e12577ef818f15e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f157 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.880139:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8a2db01/0x8e12577ef818f15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f157 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.880145:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8a2db01/0x8e12577ef818f15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f157 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.880161:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8a2db01, rc 0) 00000100:00100000:0.0:1789265274.880186:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d73fa3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+8:5814:x1876180553696000:12345-0@lo:101: Request processed in 70us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.880192:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265274.880215:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696000:0@lo:101: 00010000:00010000:0.0:1789265274.880224:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 000000006e80fbc9/0x8e12577ef818f157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265274.880230:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 000000006e80fbc9/0x8e12577ef818f157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265274.880266:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696128:0@lo:501: 00000100:00100000:0.0:1789265274.880288:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265274.880300:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056f4fb66 going to sleep for 11 seconds 00000100:00100000:0.0:1789265274.880312:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553696128 00000100:00100000:0.0:1789265274.880315:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553696128 00000100:00100000:0.0:1789265274.880355:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265274.880362:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094f32b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+8:5814:x1876180553696128:12345-0@lo:501: 00000100:00100000:0.0:1789265274.880533:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094f32b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:5814:x1876180553696128:12345-0@lo:501: Request processed in 172us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.880539:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265274.880975:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696128:0@lo:501: 00000100:00100000:0.0:1789265274.881001:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696256:0@lo:503: 00000100:00100000:0.0:1789265274.881036:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265274.881066:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056f4fb66 going to sleep for 11 seconds 00000100:00100000:0.0:1789265274.881084:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553696256 00000100:00100000:0.0:1789265274.881088:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553696256 00000100:00100000:0.0:1789265274.881156:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265274.881163:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cc1ba20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:5814:x1876180553696256:12345-0@lo:503: 00000100:00100000:0.0:1789265274.881312:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cc1ba20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:5814:x1876180553696256:12345-0@lo:503: Request processed in 149us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.881319:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265274.881413:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5ad0845 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696256:0@lo:503: 00000100:00100000:1.0:1789265274.881980:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004602ccaa pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5856:1876180553696384:0@lo:502: 00000100:00100000:1.0:1789265274.882016:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882044:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 000000003eb1e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265274.882095:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553696384 00000100:00100000:3.0:1789265274.882100:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553696384 00000100:00100000:3.0:1789265274.882131:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265274.882137:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ae0ee1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:5856:x1876180553696384:12345-0@lo:502: 00000100:00100000:3.0:1789265274.882298:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ae0ee1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:5856:x1876180553696384:12345-0@lo:502: Request processed in 161us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265274.882305:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265274.882407:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004602ccaa pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5856:1876180553696384:0@lo:502: 00000020:01000000:1.0:1789265274.882429:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265274.882439:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265274.882442:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789265274.882454:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789265274.882457:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265274.882471:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007f2fae06) 00000020:00000080:1.0:1789265274.882489:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789265274.882495:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789265274.882568:0:5856:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789265274.882574:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef818f16c 00000020:00000080:1.0:1789265274.882787:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789265274.882791:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265274.882795:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265274.882796:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789265274.882799:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265274.882802:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265274.882803:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789265274.882806:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265274.882813:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a10c3ce4) 00000020:00000080:1.0:1789265274.882821:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789265274.882825:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789265274.882826:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789265274.882828:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789265274.882833:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265274.882880:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d4e2b468 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789265274.882893:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b4d4f4de) 00000020:00000080:1.0:1789265274.882900:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789265274.882969:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789265274.882975:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef818f181 00000020:00000080:1.0:1789265274.883070:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789265274.883076:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789265274.883080:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8e12577ef818f188 00080000:01000000:1.0:1789265274.883085:0:5856:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789265274.883088:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef818f18f 00080000:10000000:1.0:1789265274.883508:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789265274.883697:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789265274.888184:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789265274.973835:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789265274.974856:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789265274.982874:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789265274.983252:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789265275.111384:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000030a7ef10) 00000020:00000080:3.0:1789265275.111477:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789265275.111654:0:5856:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789265275.111661:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef818f19d 00000020:00000080:0.0:1789265275.118110:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789265275.123002:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265275.202185:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265275.245277:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265275.286850:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265275.409010:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1789265275.436983:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789265275.506142:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789265275.558300:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8e12577ef818f1a4 00000020:00000080:2.0:1789265275.559281:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789265275.559293:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265275.559299:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265275.559703:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789265275.559717:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265275.559724:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265275.559726:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789265275.559731:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789265275.559775:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789265275.559792:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265275.559796:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265275.559798:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789265275.559801:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265275.559803:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265275.559804:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265275.559808:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265275.559810:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789265275.559865:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058c2835c pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5856:1876180553696512:0@lo:502: 00000100:00100000:2.0:1789265275.559955:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265275.560073:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040008a36 going to sleep for 11 seconds 00000100:00100000:3.0:1789265275.560181:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553696512 00000100:00100000:3.0:1789265275.560191:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553696512 00000100:00100000:3.0:1789265275.560276:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265275.560287:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007632adc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:5856:x1876180553696512:12345-0@lo:502: 00000100:00100000:3.0:1789265275.560760:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007632adc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:5856:x1876180553696512:12345-0@lo:502: Request processed in 475us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265275.560768:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265275.560859:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058c2835c pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5856:1876180553696512:0@lo:502: 00000020:01000000:2.0:1789265275.560888:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265275.560893:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265275.560895:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265275.560898:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789265275.561241:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789265275.561266:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265275.561288:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 000000006e80fbc9/0x8e12577ef818f157 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.561299:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 000000006e80fbc9/0x8e12577ef818f157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265275.561316:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff925409ebd800 from 1 10000000:01000000:1.0:1789265275.561319:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265275.561370:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.561378:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.561385:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265275.561402:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004602ccaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696640:0@lo:101: 00000100:00100000:1.0:1789265275.561438:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265275.562325:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e52337bf going to sleep for 11 seconds 00000100:00100000:0.0:1789265275.562806:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553696640 00000100:00100000:0.0:1789265275.562815:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553696640 00000100:00100000:1.0:1789265275.562921:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265275.562930:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006772711d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:5814:x1876180553696640:12345-0@lo:101: 00010000:00010000:1.0:1789265275.562955:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265275.562973:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f1ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.563014:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.563025:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.563033:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca8ce594, rc 0) 00000100:00100000:1.0:1789265275.563092:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006772711d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:5814:x1876180553696640:12345-0@lo:101: Request processed in 164us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265275.563098:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265275.563196:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004602ccaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696640:0@lo:101: 00010000:00010000:0.0:1789265275.563212:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.563221:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265275.564208:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696768:0@lo:256: 00000100:00100000:0.0:1789265275.564256:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.564671:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df645f7b going to sleep for 11 seconds 00000100:00100000:3.0:1789265275.564750:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553696768 00000100:00100000:3.0:1789265275.564757:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553696768 00000100:00100000:2.0:1789265275.564878:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265275.564889:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004675864c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:5814:x1876180553696768:12345-0@lo:256: 20000000:01000000:2.0:1789265275.564907:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789265275.564912:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789265275.564992:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004675864c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:5814:x1876180553696768:12345-0@lo:256: Request processed in 106us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265275.564999:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265275.565086:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696768:0@lo:256: 10000000:01000000:0.0:1789265275.565722:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265275.565742:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.565753:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265275.565771:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925409ebd800 from 1 10000000:01000000:0.0:1789265275.565774:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265275.565803:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.565809:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.565818:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265275.565835:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696896:0@lo:101: 00000100:00100000:0.0:1789265275.565874:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.566278:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df645f7b going to sleep for 11 seconds 00000100:00100000:1.0:1789265275.566496:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553696896 00000100:00100000:1.0:1789265275.566503:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553696896 00000100:00100000:1.0:1789265275.566534:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265275.566541:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a50bd73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:5814:x1876180553696896:12345-0@lo:101: 00010000:00010000:1.0:1789265275.566632:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265275.566646:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f1b9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.566667:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.566676:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.566685:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e5ecaa27, rc 0) 00000100:00100000:1.0:1789265275.566730:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a50bd73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:5814:x1876180553696896:12345-0@lo:101: Request processed in 190us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265275.566736:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265275.566839:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553696896:0@lo:101: 00010000:00010000:0.0:1789265275.566852:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.566860:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265275.566916:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697024:0@lo:501: 00000100:00100000:0.0:1789265275.566949:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.566973:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df645f7b going to sleep for 11 seconds 00000100:00100000:1.0:1789265275.567024:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553697024 00000100:00100000:1.0:1789265275.567028:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553697024 00000100:00100000:1.0:1789265275.567045:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265275.567049:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047c8a6e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:5814:x1876180553697024:12345-0@lo:501: 00000100:00100000:1.0:1789265275.567982:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047c8a6e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:5814:x1876180553697024:12345-0@lo:501: Request processed in 931us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265275.567991:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265275.568192:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697024:0@lo:501: 00000100:00100000:0.0:1789265275.568230:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697152:0@lo:503: 00000100:00100000:0.0:1789265275.568277:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.568750:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df645f7b going to sleep for 11 seconds 00000100:00100000:1.0:1789265275.568826:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553697152 00000100:00100000:1.0:1789265275.568832:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553697152 00000100:00100000:1.0:1789265275.568905:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265275.568914:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c06aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:5814:x1876180553697152:12345-0@lo:503: 00000040:00080000:1.0:1789265275.568969:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265275.569057:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c06aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:5814:x1876180553697152:12345-0@lo:503: Request processed in 145us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265275.569064:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265275.569145:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697152:0@lo:503: 00000040:00080000:2.0:1789265275.570792:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789265275.570979:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789265275.570999:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265275.571042:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.571055:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265275.571094:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789265275.571097:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff925409ebd800 10000000:01000000:0.0:1789265275.571100:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff925409ebd800 10000000:01000000:0.0:1789265275.571103:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265275.571108:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff925409ebd800 from 1 10000000:01000000:0.0:1789265275.571110:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265275.571140:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 000000007978db90/0x8e12577ef818f1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.571147:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 000000007978db90/0x8e12577ef818f1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.571155:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 000000007978db90/0x8e12577ef818f1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265275.571172:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697280:0@lo:101: 00000100:00100000:0.0:1789265275.571226:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.571266:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059816a27 going to sleep for 11 seconds 00000100:00100000:3.0:1789265275.571356:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553697280 00000100:00100000:3.0:1789265275.571363:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553697280 00000100:00100000:3.0:1789265275.571409:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265275.571416:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f621efc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:5814:x1876180553697280:12345-0@lo:101: 00010000:00010000:3.0:1789265275.571427:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265275.571439:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000babb2c4f/0x8e12577ef818f1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f1c7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265275.571458:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000babb2c4f/0x8e12577ef818f1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265275.571467:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000babb2c4f/0x8e12577ef818f1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265275.571476:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000babb2c4f, rc 0) 00000100:00100000:3.0:1789265275.571516:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f621efc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5814:x1876180553697280:12345-0@lo:101: Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265275.571522:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265275.571739:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a04df90d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697280:0@lo:101: 00010000:00010000:1.0:1789265275.571751:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 000000007978db90/0x8e12577ef818f1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.571759:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 000000007978db90/0x8e12577ef818f1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265275.571800:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000679ce54a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697408:0@lo:501: 00000100:00100000:1.0:1789265275.571823:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265275.571848:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ff3af80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265275.571887:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553697408 00000100:00100000:0.0:1789265275.571891:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553697408 00000100:00100000:0.0:1789265275.571919:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265275.571925:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000083d9cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5814:x1876180553697408:12345-0@lo:501: 00000100:00100000:0.0:1789265275.572148:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000083d9cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5814:x1876180553697408:12345-0@lo:501: Request processed in 223us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265275.572154:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265275.572310:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000679ce54a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697408:0@lo:501: 00000100:00100000:1.0:1789265275.572349:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000679ce54a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697536:0@lo:503: 00000100:00100000:1.0:1789265275.572444:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265275.572461:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ff3af80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265275.572501:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553697536 00000100:00100000:0.0:1789265275.572504:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553697536 00000100:00100000:0.0:1789265275.572528:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265275.572533:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7012571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5814:x1876180553697536:12345-0@lo:503: 00000100:00100000:0.0:1789265275.572861:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7012571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5814:x1876180553697536:12345-0@lo:503: Request processed in 328us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265275.572868:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265275.572953:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000679ce54a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553697536:0@lo:503: 00000100:00100000:1.0:1789265275.573767:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092b7340a pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5861:1876180553697664:0@lo:502: 00000100:00100000:1.0:1789265275.573813:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265275.573850:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ff3af80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265275.573906:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553697664 00000100:00100000:3.0:1789265275.573911:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553697664 00000100:00100000:3.0:1789265275.573955:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265275.573962:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006551d4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5861:x1876180553697664:12345-0@lo:502: 00000100:00100000:3.0:1789265275.574209:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006551d4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5861:x1876180553697664:12345-0@lo:502: Request processed in 248us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265275.574217:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265275.574328:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092b7340a pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5861:1876180553697664:0@lo:502: 00000020:01000004:1.0:1789265275.574625:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789265275.574652:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002b20d24d) 00000020:00000080:1.0:1789265275.574676:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789265275.574772:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d4e2b468 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265275.574777:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d4e2b468 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265275.574779:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d4e2b468 4 00010000:00080000:1.0:1789265275.574811:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000061543b1f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:1.0:1789265275.577220:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789265275.578655:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789265275.578694:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265275.578707:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8e12577ef818f1dc 00000100:00080000:1.0:1789265275.578717:0:5861:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265275.578722:0:5861:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000061543b1f using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1789265275.578756:0:5861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000092b7340a x1876180553697792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265275.578780:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789265275.579716:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092b7340a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553697792:0@lo:38: 00000100:00100000:2.0:1789265275.579803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265275.579960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553697792 00000100:00100000:1.0:1789265275.579967:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553697792 00000100:00100000:1.0:1789265275.580000:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265275.580007:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058c2835c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876180553697792:12345-0@lo:38: 00000100:00100000:1.0:1789265275.581709:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058c2835c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876180553697792:12345-0@lo:38: Request processed in 1695us (1901us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789265275.581732:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265275.581806:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265275.581815:0:3303:0:(import.c:65:import_set_state_nolock()) 0000000061543b1f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265275.581819:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789265275.581822:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092b7340a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553697792:0@lo:38: 00000100:00100000:1.0:1789265275.581947:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092b7340a pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5861:1876180553697920:0@lo:502: 00000100:00100000:1.0:1789265275.582002:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265275.582028:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553697920 00000100:00100000:1.0:1789265275.582033:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553697920 00000100:00100000:1.0:1789265275.582066:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265275.582072:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3565392 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5861:x1876180553697920:12345-0@lo:502: 00000100:00100000:1.0:1789265275.582296:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3565392 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5861:x1876180553697920:12345-0@lo:502: Request processed in 224us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265275.582303:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265275.582365:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8c8467f going to sleep for 11 seconds 00000100:00100000:1.0:1789265275.582377:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092b7340a pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5861:1876180553697920:0@lo:502: 00000040:00080000:1.0:1789265275.583634:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789265275.583787:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789265275.583807:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265275.583831:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 000000007978db90/0x8e12577ef818f1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265275.583842:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 000000007978db90/0x8e12577ef818f1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789265275.583890:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789265275.583892:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265275.583894:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265275.583895:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265275.583896:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265275.583898:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265275.583899:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265275.583900:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265275.583901:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265275.583903:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265275.583904:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265275.583906:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265275.583909:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789265275.583917:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265275.583918:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265275.583919:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265275.583920:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265275.583920:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265275.583921:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265275.583922:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265275.583923:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265275.583924:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265275.583924:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265275.583925:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265275.583926:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265275.583966:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789265275.583981:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063adacb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553698048:0@lo:253: 00000100:00100000:3.0:1789265275.584044:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265275.584081:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094b91801 going to sleep for 11 seconds 00000100:00100000:1.0:1789265275.584173:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553698048 00000100:00100000:1.0:1789265275.584180:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553698048 00000100:00100000:1.0:1789265275.584260:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265275.584268:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ad91ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5814:x1876180553698048:12345-0@lo:253: 20000000:01000000:1.0:1789265275.584293:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789265275.584308:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789265275.678376:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265275.678403:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789265275.678515:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789265275.678521:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789265275.678543:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.678583:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.678592:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.678634:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265275.678650:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 12 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265275.678666:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092b7340a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876180553698176:0@lo:104: 00000100:00100000:1.0:1789265275.678735:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265275.678798:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd28aff1 going to sleep for 11 seconds 00000100:00100000:0.0:1789265275.679019:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553698176 00000100:00100000:0.0:1789265275.679027:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553698176 00000100:00100000:0.0:1789265275.679082:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265275.679090:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bd12f35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5849:x1876180553698176:12345-0@lo:104: 00010000:00010000:0.0:1789265275.679101:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679156:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265275.679162:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bd12f35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5849:x1876180553698176:12345-0@lo:104: Request processed in 73us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265275.679169:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789265275.679189:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265275.679200:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679207:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe92a43e already unused, calling callback (00000000a5613620) 10000000:00010000:0.0:1789265275.679210:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679218:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265275.679224:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265275.679229:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265275.679255:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679261:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265275.679280:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679286:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: 00000000fe92a43e/0x8e12577ef818f1ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679487:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265275.679490:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265275.679491:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265275.679580:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017f10fce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553698304:0@lo:103: 00000100:00100000:0.0:1789265275.679609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.679707:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553698304 00000100:00100000:0.0:1789265275.679711:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553698304 00010000:00010000:0.0:1789265275.679733:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 13 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265275.679753:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265275.679758:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000254b7a47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3305:x1876180553698304:12345-0@lo:103: 00010000:00010000:0.0:1789265275.679768:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265275.679771:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 13 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679780:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 13 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679794:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679801:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265275.679813:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001293523s 00010000:00010000:0.0:1789265275.679816:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679822:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679828:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679832:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679837:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c766d08 already unused, calling callback (000000003291cc9e) 00010000:00010000:0.0:1789265275.679846:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679852:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679859:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.679868:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265275.679896:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000254b7a47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3305:x1876180553698304:12345-0@lo:103: Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265275.679903:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265275.679935:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017f10fce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553698304:0@lo:103: 00010000:00010000:0.0:1789265275.679974:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca8ce594/0x8e12577ef818f1b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f1ab expref: 12 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265275.679985:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092b7340a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876180553698176:0@lo:104: 00010000:00010000:0.0:1789265275.679998:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.680004:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.680009:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265275.680014:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002c766d08/0x8e12577ef818f1e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265275.704025:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ad91ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:5814:x1876180553698048:12345-0@lo:253: Request processed in 119749us (119972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265275.704056:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265275.704163:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063adacb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5814:1876180553698048:0@lo:253: 10000000:01000000:1.0:1789265275.704178:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789265275.704181:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265275.704183:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265275.704184:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265275.704185:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265275.704186:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265275.704187:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265275.704189:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265275.704190:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265275.704191:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265275.704193:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265275.704194:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265275.704195:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265275.704214:0:5814:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789265275.710845:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265275.711208:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265275.711456:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265275.711619:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265275.711809:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265275.711996:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265275.715322:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265275.715839:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265275.716140:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265275.717786:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265275.718094:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265275.718289:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1789265275.823889:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789265275.898834:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789265275.901443:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1789265275.909325:0:5866:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789265275.909344:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789265275.916981:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789265275.917293:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789265275.920167:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789265275.920193:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789265275.921621:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265275.923088:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789265275.923894:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789265275.923981:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789265275.927524:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789265275.927882:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789265275.933265:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789265275.935190:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789265275.935414:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789265275.935585:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789265275.935741:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789265275.935890:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789265275.936042:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789265275.936196:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789265275.943059:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789265275.943356:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789265275.943788:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789265275.943959:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789265275.944106:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789265275.944234:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789265275.944976:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789265275.945164:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789265275.955558:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789265275.955890:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789265275.956181:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789265275.956396:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789265275.956530:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789265275.956685:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789265275.956830:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789265275.957004:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789265275.957153:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789265275.957361:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789265275.957584:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789265275.957794:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789265275.959233:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789265275.959800:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789265275.960046:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789265275.960197:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789265275.971523:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789265276.027386:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789265276.119130:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789265276.119173:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9e5bc1c63988 00100000:10000000:3.0:1789265276.119182:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789265276.120067:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265276.120082:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265276.120095:0:5814:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789265276.120117:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789265276.225757:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789265276.225842:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1789265276.225847:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789265276.448757:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265277.470642:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265278.495279:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265279.519766:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789265279.910294:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265279.910304:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff925409ebd800 from 3 10000000:01000000:1.0:1789265279.910310:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265279.910374:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 0000000031cf9c61/0x8e12577ef818f1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265279.910388:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 0000000031cf9c61/0x8e12577ef818f1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265279.910399:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 0000000031cf9c61/0x8e12577ef818f1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265279.910424:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c75471d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553698432:0@lo:101: 00000100:00100000:1.0:1789265279.910497:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265279.910551:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d88e092e going to sleep for 11 seconds 00000100:00100000:3.0:1789265279.912304:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553698432 00000100:00100000:3.0:1789265279.912321:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553698432 00000100:00100000:3.0:1789265279.912419:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265279.912427:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036f76116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:5831:x1876180553698432:12345-0@lo:101: 00010000:00010000:3.0:1789265279.912445:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265279.912465:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb467cec/0x8e12577ef818f1f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f1ea expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265279.912495:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb467cec/0x8e12577ef818f1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265279.912505:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb467cec/0x8e12577ef818f1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265279.912515:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb467cec, rc 0) 00000100:00100000:3.0:1789265279.912812:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036f76116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5831:x1876180553698432:12345-0@lo:101: Request processed in 384us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265279.912820:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265279.913182:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c75471d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553698432:0@lo:101: 00010000:00010000:2.0:1789265279.913202:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 0000000031cf9c61/0x8e12577ef818f1ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265279.913213:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 0000000031cf9c61/0x8e12577ef818f1ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265279.913289:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6aa8457 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553698560:0@lo:256: 00000100:00100000:2.0:1789265279.913349:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265279.913385:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b76d175e going to sleep for 11 seconds 00000100:00100000:0.0:1789265279.914557:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553698560 00000100:00100000:0.0:1789265279.914570:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553698560 00000100:00100000:0.0:1789265279.914616:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265279.914624:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfae50c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5831:x1876180553698560:12345-0@lo:256: 20000000:01000000:0.0:1789265279.914643:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265279.914661:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265279.914664:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789265279.914759:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfae50c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5831:x1876180553698560:12345-0@lo:256: Request processed in 135us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265279.914766:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265279.915226:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6aa8457 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553698560:0@lo:256: 10000000:01000000:2.0:1789265279.915282:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265279.915291:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 0000000031cf9c61/0x8e12577ef818f1ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265279.915302:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 0000000031cf9c61/0x8e12577ef818f1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265280.544494:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265280.926703:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026be61b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553698688:0@lo:400: 00000100:00080000:1.0:1789265280.926703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789265280.926714:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789265280.926717:0:8:0:(import.c:65:import_set_state_nolock()) 0000000061543b1f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265280.926725:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000061543b1f using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1789265280.926746:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d02e0e8d x1876180553698816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265280.926783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265280.926786:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d02e0e8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553698816:0@lo:38: 00000100:00100000:1.0:1789265280.926816:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265280.926863:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553698688 00000100:00100000:1.0:1789265280.926863:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553698816 00000100:00100000:2.0:1789265280.926872:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553698688 00000100:00100000:1.0:1789265280.926872:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553698816 00000100:00100000:2.0:1789265280.926904:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789265280.926904:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265280.926911:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e53bbdf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3306:x1876180553698688:12345-0@lo:400: 00000100:00100000:1.0:1789265280.926911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000179a45b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876180553698816:12345-0@lo:38: 00010000:00080000:1.0:1789265280.926933:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 136 last 0 00000100:00100000:2.0:1789265280.926959:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e53bbdf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3306:x1876180553698688:12345-0@lo:400: Request processed in 48us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265280.926965:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:1.0:1789265280.926969:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8e12577ef818f1f8 00000100:00100000:2.0:1789265280.927011:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026be61b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553698688:0@lo:400: 00000004:00100000:1.0:1789265280.927017:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265280.927246:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000f5875333 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265280.927302:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000179a45b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876180553698816:12345-0@lo:38: Request processed in 391us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.927310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265280.927437:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d02e0e8d x1876180553698816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265280.927450:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789265280.927530:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789265280.927536:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265280.927538:0:3303:0:(import.c:65:import_set_state_nolock()) 0000000061543b1f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265280.927544:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d02e0e8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553698816:0@lo:38: 00010000:00010000:1.0:1789265281.569538:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265282.370227:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789265282.592895:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265283.621026:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265284.640652:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265285.663246:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265286.052554:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3ceef15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553699072:0@lo:400: 00000100:00100000:0.0:1789265286.052666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265286.052773:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265286.052791:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000578d723c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553698944:0@lo:400: 00000100:00100000:2.0:1789265286.052833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265286.052836:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553699072 00000100:00100000:1.0:1789265286.052845:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553699072 00000100:00100000:2.0:1789265286.052879:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553698944 00000100:00100000:2.0:1789265286.052885:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553698944 00000100:00100000:1.0:1789265286.052893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265286.052903:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017f10fce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553699072:12345-0@lo:400: 00000100:00100000:2.0:1789265286.052922:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265286.052931:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b360fbb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3306:x1876180553698944:12345-0@lo:400: 00000100:00100000:2.0:1789265286.052973:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b360fbb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3306:x1876180553698944:12345-0@lo:400: Request processed in 45us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265286.052980:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265286.053032:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000578d723c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553698944:0@lo:400: 00000100:00100000:1.0:1789265286.067696:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017f10fce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553699072:12345-0@lo:400: Request processed in 14786us (15032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265286.067732:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265286.075520:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c3ceef15 x1876180553699072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265286.075541:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3ceef15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553699072:0@lo:400: 00010000:00010000:1.0:1789265286.686599:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265287.710552:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789265288.516321:0:6313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceca1bfd0 20000000:00000080:2.0:1789265288.516430:0:6313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92543ca64800 uarg=0000000000000000 20000000:01000000:2.0:1789265288.516466:0:6313:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789265288.516474:0:6313:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789265288.516478:0:6313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789265288.516758:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789265288.516770:0:6313:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789265288.522167:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265288.522465:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789265288.522522:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789265288.522570:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789265288.522588:0:6313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789265288.522604:0:6313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.522624:0:6313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.522961:0:6313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.523002:0:6313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.523017:0:6313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 11 pid: 5828 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265288.523030:0:6313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6aa8457 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1876180553699200:0@lo:104: 00000100:00100000:2.0:1789265288.523096:0:6313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265288.523264:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553699200 00000100:00100000:1.0:1789265288.523272:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553699200 00000100:00100000:1.0:1789265288.523361:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265288.523370:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c55c17e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:6313:x1876180553699200:12345-0@lo:104: 00010000:00010000:1.0:1789265288.523382:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.523429:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265288.523434:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c55c17e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:6313:x1876180553699200:12345-0@lo:104: Request processed in 67us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265288.523441:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265288.523512:0:6313:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1beca5c going to sleep for 11 seconds 00000100:00100000:2.0:1789265288.523533:0:6313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6aa8457 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1876180553699200:0@lo:104: 00010000:00010000:2.0:1789265288.523561:0:6313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.523871:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265288.523878:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.523887:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003eca68eb already unused, calling callback (00000000a5613620) 10000000:00010000:3.0:1789265288.523890:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.523908:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265288.523915:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265288.523920:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265288.523955:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.523962:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789265288.524007:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4cd7185 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553699328:0@lo:103: 00000100:00100000:0.0:1789265288.524041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265288.524108:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553699328 00000100:00100000:1.0:1789265288.524113:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553699328 00010000:00010000:1.0:1789265288.524130:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 12 pid: 5828 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265288.524165:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265288.524171:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094a38619 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3305:x1876180553699328:12345-0@lo:103: 00010000:00010000:1.0:1789265288.524181:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265288.524185:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 12 pid: 5828 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524194:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 12 pid: 5828 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524206:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e5ecaa27/0x8e12577ef818f1c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f1b9 expref: 12 pid: 5828 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524233:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524239:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524251:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524257:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524263:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524268:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524273:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001bb37fa9 already unused, calling callback (000000003291cc9e) 00010000:00010000:1.0:1789265288.524276:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524281:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524291:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265288.524299:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:2.0:1789265288.524451:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265288.524455:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925409ebd800 from 1 10000000:01000000:2.0:1789265288.524458:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265288.524479:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 00000000fcf4d147/0x8e12577ef818f206 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.524485:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 00000000fcf4d147/0x8e12577ef818f206 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.524492:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 00000000fcf4d147/0x8e12577ef818f206 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265288.524501:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6aa8457 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553699456:0@lo:101: 00000100:00100000:2.0:1789265288.524526:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265288.524545:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1beca5c going to sleep for 11 seconds 00000100:00100000:2.0:1789265288.524558:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553699456 00000100:00100000:2.0:1789265288.524560:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553699456 00000100:00100000:2.0:1789265288.524584:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265288.524590:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e231ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5831:x1876180553699456:12345-0@lo:101: 00010000:00010000:2.0:1789265288.524601:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265288.524610:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8038c26/0x8e12577ef818f20d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f206 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.524624:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8038c26/0x8e12577ef818f20d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f206 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.524737:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.524745:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: 000000003eca68eb/0x8e12577ef818f1b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.524758:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265288.524760:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265288.524762:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265288.524802:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8038c26/0x8e12577ef818f20d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f206 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.524815:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8038c26, rc 0) 00000100:00100000:2.0:1789265288.524853:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e231ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553699456:12345-0@lo:101: Request processed in 264us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265288.524860:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1789265288.524892:0:6313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.524899:0:6313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265288.524904:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001bb37fa9/0x8e12577ef818f1ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265288.525232:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6aa8457 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553699456:0@lo:101: 00010000:00010000:3.0:1789265288.525246:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 00000000fcf4d147/0x8e12577ef818f206 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.525254:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 00000000fcf4d147/0x8e12577ef818f206 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265288.525300:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8e4feb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553699584:0@lo:501: 00000100:00100000:3.0:1789265288.525355:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265288.525371:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c83f6c26 going to sleep for 11 seconds 00000100:00100000:3.0:1789265288.525435:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553699584 00000100:00100000:3.0:1789265288.525438:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553699584 00000100:00100000:3.0:1789265288.525462:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265288.525468:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044ca4083 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553699584:12345-0@lo:501: 00000100:00100000:3.0:1789265288.525782:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044ca4083 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553699584:12345-0@lo:501: Request processed in 313us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265288.525789:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265288.525823:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8e4feb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553699584:0@lo:501: 00000100:00100000:3.0:1789265288.525849:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8e4feb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553699712:0@lo:503: 00000100:00100000:3.0:1789265288.525886:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265288.525900:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c83f6c26 going to sleep for 11 seconds 00000100:00100000:3.0:1789265288.525912:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553699712 00000100:00100000:3.0:1789265288.525916:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553699712 00000100:00100000:3.0:1789265288.525936:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265288.525941:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f793633a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553699712:12345-0@lo:503: 00000100:00100000:3.0:1789265288.526056:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f793633a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553699712:12345-0@lo:503: Request processed in 114us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265288.526063:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265288.526098:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8e4feb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553699712:0@lo:503: 00000100:00100000:3.0:1789265288.526404:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8e4feb pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6314:1876180553699840:0@lo:502: 00000100:00100000:3.0:1789265288.526438:0:6314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265288.526464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553699840 00000100:00100000:3.0:1789265288.526468:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553699840 00000100:00100000:3.0:1789265288.526490:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265288.526504:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a67024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6314:x1876180553699840:12345-0@lo:502: 00000100:00100000:3.0:1789265288.526608:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a67024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6314:x1876180553699840:12345-0@lo:502: Request processed in 105us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265288.526615:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265288.526717:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba5a674a going to sleep for 11 seconds 00000100:00100000:3.0:1789265288.526729:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8e4feb pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6314:1876180553699840:0@lo:502: 00000020:01000000:3.0:1789265288.526751:0:6314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265288.526760:0:6314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265288.526762:0:6314:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265288.526772:0:6314:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff925409ebd800 00000020:00000080:3.0:1789265288.526774:0:6314:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265288.526813:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6314:1876180553699968:0@lo:502: 00000100:00100000:3.0:1789265288.526845:0:6314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265288.526864:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553699968 00000100:00100000:3.0:1789265288.526868:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553699968 00000100:00100000:3.0:1789265288.526888:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265288.526895:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6314:x1876180553699968:12345-0@lo:502: 00000100:00100000:3.0:1789265288.526986:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6314:x1876180553699968:12345-0@lo:502: Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265288.526993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265288.527021:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254032806c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265288.527032:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6314:1876180553699968:0@lo:502: 00000020:01000000:3.0:1789265288.527049:0:6314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265288.527053:0:6314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265288.527055:0:6314:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789265288.527059:0:6314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789265288.527106:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789265288.527127:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265288.528554:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265288.528573:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265288.529034:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3305:x1876180553699328:12345-0@lo:103: Request processed in 4858us (4988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265288.529060:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265288.530469:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553699328:0@lo:103: 00010000:00010000:1.0:1789265288.734549:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265289.760464:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265290.785229:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265291.174137:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553700096:0@lo:400: 00000100:00100000:2.0:1789265291.174231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265291.174424:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553700096 00000100:00100000:3.0:1789265291.174433:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553700096 00000100:00100000:3.0:1789265291.174486:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265291.174496:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3306:x1876180553700096:12345-0@lo:400: 00000100:00100000:1.0:1789265291.175431:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553700224:0@lo:400: 00000100:00100000:1.0:1789265291.175482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265291.175546:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553700224 00000100:00100000:1.0:1789265291.175553:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553700224 00000100:00100000:1.0:1789265291.175590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265291.175598:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553700224:12345-0@lo:400: 00000100:00100000:1.0:1789265291.175652:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553700224:12345-0@lo:400: Request processed in 55us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265291.175659:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265291.175700:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92540353ce00 x1876180553700224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265291.175714:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553700224:0@lo:400: 00000100:00100000:3.0:1789265291.176177:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3306:x1876180553700096:12345-0@lo:400: Request processed in 1681us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265291.176187:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265291.183508:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553700096:0@lo:400: 00010000:00010000:0.0:1789265291.808919:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265292.830457:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265293.856304:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265294.879462:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265295.814715:0:6676:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265295.814721:0:6676:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789265295.814855:0:6676:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92543b68a800 00000020:01000004:3.0:1789265295.814873:0:6676:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789265295.814885:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789265295.815254:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92543d3bb370) 00000020:00000080:3.0:1789265295.815272:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789265295.845245:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789265295.845667:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789265295.891679:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00010000:00010000:1.0:1789265295.902883:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789265295.909484:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789265295.909535:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789265295.909837:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789265295.909867:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789265295.910268:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789265295.910280:0:6676:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789265295.910292:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8e12577ef818f21b 00000020:01000004:1.0:1789265295.910300:0:6676:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789265295.910321:0:6676:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.143@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789265295.910325:0:6676:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789265295.910370:0:6676:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789265295.910376:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789265295.910388:0:6676:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9254373c3370) 00000020:00000080:1.0:1789265295.910401:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1789265295.911612:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265295.911813:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265295.911819:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789265295.926117:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789265295.926135:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789265295.928134:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265295.928156:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789265295.932693:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265295.933767:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789265295.933775:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789265295.937278:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789265295.937300:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789265295.990126:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265295.992044:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265295.992060:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789265296.009806:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265296.009910:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789265296.015316:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265296.015364:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789265296.021224:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265296.021491:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789265296.021497:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789265296.023280:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789265296.023292:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789265296.061288:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265296.061556:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789265296.061562:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789265296.071650:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789265296.071667:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789265296.079418:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789265296.079460:0:6676:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789265296.079467:0:6676:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789265296.142509:0:6676:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789265296.142567:0:6676:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.143@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789265296.142571:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789265296.142573:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265296.142575:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265296.142576:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265296.142577:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265296.142579:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265296.142580:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265296.142582:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265296.142583:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265296.142584:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265296.142586:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265296.142589:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789265296.142592:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265296.142593:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265296.142595:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265296.142596:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265296.142597:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265296.142598:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265296.142603:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265296.142604:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265296.142605:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265296.142606:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265296.142607:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265296.142637:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789265296.142656:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553700352:0@lo:253: 00000100:00100000:0.0:1789265296.142725:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.142803:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403e62300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265296.143276:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553700352 00000100:00100000:3.0:1789265296.143285:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553700352 00000100:00100000:3.0:1789265296.143382:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265296.143392:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553700352:12345-0@lo:253: 20000000:01000000:3.0:1789265296.143424:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789265296.143427:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789265296.143433:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789265296.143436:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789265296.145683:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265296.147003:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789265296.147025:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789265296.147071:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789265296.147077:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789265296.147100:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789265296.148923:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789265296.149563:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789265296.149592:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.143@tcp 20000000:01000000:3.0:1789265296.149594:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:3.0:1789265296.149631:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789265296.149639:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789265296.149698:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789265296.149707:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:3.0:1789265296.149739:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789265296.149748:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265296.149778:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789265296.149830:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789265296.154060:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789265296.154094:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.143@tcp 20000000:01000000:3.0:1789265296.154097:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:3.0:1789265296.154133:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789265296.155045:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789265296.155116:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789265296.155125:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:3.0:1789265296.155200:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789265296.155211:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265296.155246:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789265296.155280:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789265296.155302:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789265296.155306:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789265296.155312:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789265296.155314:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789265296.155317:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789265296.155374:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789265296.155378:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789265296.155418:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789265296.155421:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265296.162749:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265296.162964:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265296.163019:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789265296.163954:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789265296.164003:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789265296.164092:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789265296.164108:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789265296.164111:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265296.168267:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265296.168398:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265296.168451:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789265296.169108:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789265296.169651:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789265296.169689:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789265296.169979:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789265296.169982:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789265296.171270:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789265296.171755:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789265296.171925:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789265296.171996:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1789265296.172014:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789265296.172033:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.172052:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403136400/0x8e12577ef818f142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f13b expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.172072:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925400031600/0x8e12577ef818f15e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f157 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.172079:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254027de200/0x8e12577ef818f1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.172088:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.172125:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254027de200/0x8e12577ef818f1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.172426:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9254027de200/0x8e12577ef818f1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 12 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.172442:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1876180553700480:0@lo:104: 00000100:00100000:3.0:1789265296.172873:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265296.172985:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925400031600/0x8e12577ef818f15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f157 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.172997:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925400031600/0x8e12577ef818f15e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f157 expref: 12 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.173007:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1876180553700608:0@lo:104: 00000100:00100000:3.0:1789265296.173029:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265296.173253:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403136400/0x8e12577ef818f142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f13b expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.173263:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925403136400/0x8e12577ef818f142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f13b expref: 12 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.173284:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1876180553700736:0@lo:104: 00000100:00100000:3.0:1789265296.173305:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.173417:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553700480 00000100:00100000:0.0:1789265296.173425:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553700480 00000100:00100000:1.0:1789265296.173691:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553700608 00000100:00100000:1.0:1789265296.173695:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553700608 00000100:00100000:1.0:1789265296.173722:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265296.173731:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:5825:x1876180553700480:12345-0@lo:104: 00010000:00010000:1.0:1789265296.173742:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.173818:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265296.173826:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:5825:x1876180553700480:12345-0@lo:104: Request processed in 96us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.173834:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265296.173853:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265296.173858:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5825:x1876180553700608:12345-0@lo:104: 00010000:00010000:1.0:1789265296.173865:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.173909:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265296.173915:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5825:x1876180553700608:12345-0@lo:104: Request processed in 57us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.173921:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789265296.173944:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265296.173950:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.173958:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030400 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1789265296.173962:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.173971:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265296.173978:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265296.173984:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265296.174013:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f1c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174020:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265296.174038:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f1c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174044:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f1c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174071:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265296.174074:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174080:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1789265296.174083:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174089:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265296.174095:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265296.174099:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265296.174129:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174327:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265296.174354:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f157 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174361:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f15e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174372:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265296.174374:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265296.174376:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265296.174399:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553700864:0@lo:103: 00000100:00100000:1.0:1789265296.174435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265296.174602:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265296.174609:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553700992:0@lo:103: 00000100:00100000:1.0:1789265296.174633:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265296.174665:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553700864 00000100:00100000:1.0:1789265296.174670:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553700864 00010000:00010000:1.0:1789265296.174688:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254027de200/0x8e12577ef818f1ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 13 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.174708:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553700992 00000100:00100000:1.0:1789265296.174711:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553700992 00010000:00010000:1.0:1789265296.174722:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925400031600/0x8e12577ef818f15e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f157 expref: 14 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.174733:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265296.174739:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:3304:x1876180553700864:12345-0@lo:103: 00010000:00010000:1.0:1789265296.174749:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265296.174754:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254027de200/0x8e12577ef818f1ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 14 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.174765:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254027de200/0x8e12577ef818f1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 14 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.174870:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265296.174932:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265296.175006:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:3304:x1876180553700864:12345-0@lo:103: Request processed in 267us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.175013:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265296.175027:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265296.175033:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3304:x1876180553700992:12345-0@lo:103: 00010000:00010000:1.0:1789265296.175048:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265296.175053:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925400031600/0x8e12577ef818f15e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f157 expref: 13 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.175061:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925400031600/0x8e12577ef818f15e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f157 expref: 13 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.175070:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265296.175091:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3304:x1876180553700992:12345-0@lo:103: Request processed in 59us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.175096:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265296.175512:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b3cd240 going to sleep for 11 seconds 00010000:00010000:3.0:1789265296.175533:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027de200/0x8e12577ef818f1ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f1c7 expref: 12 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.175555:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1876180553700480:0@lo:104: 00010000:00010000:3.0:1789265296.175566:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400031600/0x8e12577ef818f15e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f157 expref: 11 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.175577:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1876180553700608:0@lo:104: 00000100:00100000:1.0:1789265296.176733:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553700736 00000100:00100000:1.0:1789265296.176744:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553700736 00000100:00100000:1.0:1789265296.176795:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265296.176803:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5825:x1876180553700736:12345-0@lo:104: 00010000:00010000:1.0:1789265296.176816:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.176896:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265296.176903:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5825:x1876180553700736:12345-0@lo:104: Request processed in 101us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.176909:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265296.177037:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1876180553700736:0@lo:104: 00010000:00010000:3.0:1789265296.177063:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177108:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265296.177114:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177122:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027dfc00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:0.0:1789265296.177127:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177254:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265296.177263:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265296.177269:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265296.177324:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f13b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177361:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265296.177381:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f13b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177389:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f13b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f142 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177413:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265296.177415:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265296.177416:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265296.177475:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553701120:0@lo:103: 00000100:00100000:3.0:1789265296.177523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.177972:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553701120 00000100:00100000:0.0:1789265296.177978:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553701120 00010000:00010000:0.0:1789265296.178002:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403136400/0x8e12577ef818f142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f13b expref: 11 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.178035:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265296.178043:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:3306:x1876180553701120:12345-0@lo:103: 00010000:00010000:0.0:1789265296.178054:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265296.178059:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403136400/0x8e12577ef818f142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f13b expref: 11 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178069:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403136400/0x8e12577ef818f142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f13b expref: 11 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178083:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136400/0x8e12577ef818f142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f13b expref: 11 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178097:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178114:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178130:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178259:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178268:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178275:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178281:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027dfa00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265296.178285:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178293:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178306:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.178316:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265296.178391:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:3306:x1876180553701120:12345-0@lo:103: Request processed in 349us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.178398:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265296.181589:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553701120:0@lo:103: 00010000:00010000:3.0:1789265296.181633:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.181644:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.181651:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f229 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265296.181698:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789265296.183292:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553700864:0@lo:103: 00000100:00100000:2.0:1789265296.183318:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553700992:0@lo:103: 00000100:00100000:1.0:1789265296.264172:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:6676:x1876180553700352:12345-0@lo:253: Request processed in 120770us (121435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.264187:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265296.264414:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553700352:0@lo:253: 10000000:01000000:0.0:1789265296.264446:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789265296.264450:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265296.264451:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265296.264453:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265296.264454:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789265296.264455:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265296.264456:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265296.264458:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265296.264460:0:6676:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789265296.264462:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265296.264463:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265296.264484:0:6676:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92543b68a800 from lustre-OST0000 10000000:01000000:0.0:1789265296.264592:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789265296.264596:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789265296.264604:0:6676:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff925402d54d28 local copy 10000000:01000000:0.0:1789265296.264609:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789265296.264656:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.264667:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.264677:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.264695:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701248:0@lo:101: 00000100:00100000:0.0:1789265296.264734:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265296.264879:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553701248 00000100:00100000:2.0:1789265296.264886:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553701248 00000100:00100000:2.0:1789265296.264933:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265296.264943:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:6676:x1876180553701248:12345-0@lo:101: 00010000:00010000:2.0:1789265296.264956:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265296.264970:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403137000/0x8e12577ef818f237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f230 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.265006:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137000/0x8e12577ef818f237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f230 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.265017:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403137000/0x8e12577ef818f237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f230 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.265027:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137000, rc 0) 00000100:00100000:2.0:1789265296.265056:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:6676:x1876180553701248:12345-0@lo:101: Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265296.265062:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265296.265243:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265296.265257:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701248:0@lo:101: 00010000:00010000:0.0:1789265296.265268:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.265288:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.265458:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701376:0@lo:501: 00000100:00100000:0.0:1789265296.265485:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.265525:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265296.268039:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553701376 00000100:00100000:2.0:1789265296.268054:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553701376 00000100:00100000:2.0:1789265296.268130:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265296.268267:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:6676:x1876180553701376:12345-0@lo:501: 00000100:00100000:2.0:1789265296.269306:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:6676:x1876180553701376:12345-0@lo:501: Request processed in 1038us (3814us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265296.269318:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265296.269684:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701376:0@lo:501: 10000000:01000000:0.0:1789265296.269708:0:6676:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789265296.269754:0:6676:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789265296.269763:0:6676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.269854:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.269863:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.269891:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789265296.269920:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92543b68a800 10000000:01000000:0.0:1789265296.269925:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789265296.269931:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff925402d54d28 10000000:01000000:0.0:1789265296.269934:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789265296.269938:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff925402d54d28 from 1 10000000:01000000:0.0:1789265296.269941:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789265296.269975:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.270077:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.270089:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.270111:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701504:0@lo:101: 00000100:00100000:0.0:1789265296.270245:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.270278:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.270369:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553701504 00000100:00100000:1.0:1789265296.270376:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553701504 00000100:00100000:1.0:1789265296.270427:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265296.270436:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:6676:x1876180553701504:12345-0@lo:101: 00010000:00010000:1.0:1789265296.270460:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265296.270475:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207cc00/0x8e12577ef818f245 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f23e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.270507:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207cc00/0x8e12577ef818f245 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f23e expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.270517:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207cc00/0x8e12577ef818f245 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f23e expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.270526:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207cc00, rc 0) 00000100:00100000:1.0:1789265296.270583:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553701504:12345-0@lo:101: Request processed in 149us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.270590:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265296.270633:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701504:0@lo:101: 00010000:00010000:1.0:1789265296.270646:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f245 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.270655:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f245 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265296.270673:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789265296.270682:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f245 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.270689:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f245 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265296.270697:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789265296.270706:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265296.270711:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789265296.270714:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265296.270730:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.270738:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.270745:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.270758:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701632:0@lo:101: 00010000:00010000:2.0:1789265296.271215:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265296.271232:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.271240:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265296.271244:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.271253:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265296.271260:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265296.271266:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265296.271286:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.271293:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265296.271315:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.271323:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f230 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e12577ef818f237 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.271371:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265296.271373:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265296.271374:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265296.271382:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265296.271398:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553701760:0@lo:103: 00000100:00100000:2.0:1789265296.271755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.272370:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553701760 00000100:00100000:0.0:1789265296.272381:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553701760 00000100:00100000:0.0:1789265296.272448:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265296.272470:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:3306:x1876180553701760:12345-0@lo:103: 00010000:00010000:0.0:1789265296.272484:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265296.272514:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137000/0x8e12577ef818f237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f230 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.272548:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265296.272607:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:3306:x1876180553701760:12345-0@lo:103: Request processed in 139us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.272615:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265296.272855:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553701760:0@lo:103: 00000100:00100000:1.0:1789265296.273680:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265296.273744:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265296.273893:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553701632 00000100:00100000:2.0:1789265296.273925:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553701632 00000100:00100000:2.0:1789265296.273981:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265296.274001:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+10:6676:x1876180553701632:12345-0@lo:101: 00010000:00010000:2.0:1789265296.274015:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265296.274038:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f24c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.274065:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f24c expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.274075:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f24c expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.274085:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137c00, rc 0) 00000100:00100000:2.0:1789265296.274274:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553701632:12345-0@lo:101: Request processed in 274us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265296.274282:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789265296.281444:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701632:0@lo:101: 00010000:00010000:0.0:1789265296.281480:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.281493:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.281693:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701888:0@lo:501: 00000100:00100000:0.0:1789265296.281762:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.281818:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265296.282194:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553701888 00000100:00100000:2.0:1789265296.282201:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553701888 00000100:00100000:2.0:1789265296.282249:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265296.282257:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553701888:12345-0@lo:501: 00000100:00100000:2.0:1789265296.282602:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553701888:12345-0@lo:501: Request processed in 345us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265296.282611:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265296.283036:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553701888:0@lo:501: 00000100:00100000:0.0:1789265296.283088:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702016:0@lo:503: 00000100:00100000:0.0:1789265296.283149:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.283183:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.283289:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553702016 00000100:00100000:1.0:1789265296.283295:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553702016 00000100:00100000:1.0:1789265296.283448:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265296.283457:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553702016:12345-0@lo:503: 00000100:00100000:1.0:1789265296.283643:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553702016:12345-0@lo:503: Request processed in 187us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.283651:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265296.284013:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702016:0@lo:503: 00000040:00080000:0.0:1789265296.284403:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265296.284471:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702144:0@lo:502: 00000100:00100000:0.0:1789265296.284514:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.284557:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.284647:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553702144 00000100:00100000:1.0:1789265296.284652:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553702144 00000100:00100000:1.0:1789265296.284682:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265296.284690:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553702144:12345-0@lo:502: 00000100:00100000:1.0:1789265296.284855:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553702144:12345-0@lo:502: Request processed in 164us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.284861:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265296.285085:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702144:0@lo:502: 00000040:00080000:0.0:1789265296.285443:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789265296.285493:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789265296.285524:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789265296.286017:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789265296.286068:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789265296.286107:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789265296.286221:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702272:0@lo:502: 00000100:00100000:0.0:1789265296.286278:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.286319:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265296.286517:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553702272 00000100:00100000:2.0:1789265296.286524:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553702272 00000100:00100000:2.0:1789265296.286588:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265296.286597:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553702272:12345-0@lo:502: 00000100:00100000:2.0:1789265296.287104:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553702272:12345-0@lo:502: Request processed in 506us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265296.287120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265296.287297:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702272:0@lo:502: 00000040:00080000:0.0:1789265296.287466:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789265296.287484:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:1.0:1789265296.288284:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553702400:0@lo:400: 00000100:00100000:1.0:1789265296.288364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.288462:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553702400 00000100:00100000:0.0:1789265296.288469:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553702400 00000100:00100000:0.0:1789265296.288519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265296.288527:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553702400:12345-0@lo:400: 00000100:00100000:0.0:1789265296.288588:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553702400:12345-0@lo:400: Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.288596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789265296.288678:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92543b9dea00 x1876180553702400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265296.288693:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553702400:0@lo:400: 00000020:01000000:2.0:1789265296.289502:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265296.289511:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789265296.289518:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265296.289520:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789265296.289527:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265296.289570:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff925403ed4d28) 00000020:00000080:2.0:1789265296.289591:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789265296.289597:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789265296.289683:0:6694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92543b68a800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789265296.289691:0:6694:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265296.289698:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8e12577ef818f261 00010000:00010000:3.0:1789265296.300513:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789265296.301523:0:6694:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789265296.306453:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789265296.306803:0:6694:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789265296.319434:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789265296.319889:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789265296.323298:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789265296.323312:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265296.323319:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265296.323321:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789265296.323325:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265296.323329:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265296.323353:0:6694:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265296.323358:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265296.323360:0:6694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265296.323431:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265296.323435:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265296.323437:0:6694:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265296.323441:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789265296.323729:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789265296.323762:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789265296.323786:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.323801:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265296.323810:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92543b68a800 from 1 10000000:01000000:1.0:1789265296.323813:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265296.323852:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.323861:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.323872:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.323899:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702528:0@lo:101: 00000100:00100000:1.0:1789265296.323967:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265296.324027:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265296.324111:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553702528 00000100:00100000:3.0:1789265296.324121:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553702528 00000100:00100000:3.0:1789265296.324172:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265296.324182:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:6676:x1876180553702528:12345-0@lo:101: 00010000:00010000:3.0:1789265296.324196:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265296.324211:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f268 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.324235:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f268 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.324245:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f268 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.324253:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9254027dfa00, rc 0) 00000100:00100000:3.0:1789265296.324293:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553702528:12345-0@lo:101: Request processed in 113us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.324299:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265296.324525:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702528:0@lo:101: 00010000:00010000:1.0:1789265296.324569:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.324578:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.324683:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702656:0@lo:501: 00000100:00100000:1.0:1789265296.324712:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265296.324744:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.324761:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553702656 00000100:00100000:1.0:1789265296.324766:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553702656 00000100:00100000:1.0:1789265296.324793:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265296.324799:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553702656:12345-0@lo:501: 00000100:00100000:1.0:1789265296.325002:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553702656:12345-0@lo:501: Request processed in 201us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.325009:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265296.325041:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702656:0@lo:501: 00000100:00100000:1.0:1789265296.325425:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702784:0@lo:503: 00000100:00100000:1.0:1789265296.325464:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265296.325633:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265296.326046:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553702784 00000100:00100000:3.0:1789265296.326053:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553702784 00000100:00100000:3.0:1789265296.326201:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265296.326211:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553702784:12345-0@lo:503: 00000100:00100000:3.0:1789265296.326657:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553702784:12345-0@lo:503: Request processed in 446us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.326666:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265296.326997:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702784:0@lo:503: 00000040:00080000:2.0:1789265296.327940:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265296.328022:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702912:0@lo:502: 00000100:00100000:2.0:1789265296.328120:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265296.329352:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254036f0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.329547:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553702912 00000100:00100000:1.0:1789265296.329555:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553702912 00000100:00100000:1.0:1789265296.329600:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265296.329609:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553702912:12345-0@lo:502: 00000100:00100000:3.0:1789265296.340517:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553702912:0@lo:502: 00000040:00080000:3.0:1789265296.340901:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789265296.340967:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789265296.341015:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703040:0@lo:502: 00000100:00100000:1.0:1789265296.341203:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553702912:12345-0@lo:502: Request processed in 11591us (13080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.341216:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265296.341549:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265296.341596:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b3cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.342142:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553703040 00000100:00100000:1.0:1789265296.342151:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553703040 00000100:00100000:1.0:1789265296.342207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265296.342218:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553703040:12345-0@lo:502: 00000100:00100000:1.0:1789265296.342563:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553703040:12345-0@lo:502: Request processed in 346us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.342571:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265296.342687:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703040:0@lo:502: 00000040:00080000:3.0:1789265296.342848:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789265296.342863:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789265296.344188:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265296.344200:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265296.344203:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265296.344209:0:6698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92543b68a800 00000020:00000080:3.0:1789265296.344211:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265296.344232:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265296.344236:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265296.344237:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789265296.344240:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789265296.345881:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789265296.345925:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265296.345957:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.345970:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265296.346024:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789265296.346028:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92543b68a800 10000000:01000000:0.0:1789265296.346032:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92543b68a800 10000000:01000000:0.0:1789265296.346037:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265296.346045:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92543b68a800 from 1 10000000:01000000:0.0:1789265296.346048:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265296.346087:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.346096:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.346106:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.346141:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703168:0@lo:101: 00000100:00100000:0.0:1789265296.346211:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.346303:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265296.346647:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553703168 00000100:00100000:3.0:1789265296.346656:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553703168 00000100:00100000:3.0:1789265296.346739:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265296.346750:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553703168:12345-0@lo:101: 00010000:00010000:3.0:1789265296.346765:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265296.346779:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f276 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.346818:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f276 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.346830:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f276 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.346840:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9254027de200, rc 0) 00000100:00100000:3.0:1789265296.346897:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703168:12345-0@lo:101: Request processed in 149us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.346905:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265296.346996:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703168:0@lo:101: 00010000:00010000:1.0:1789265296.347015:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.347026:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.347215:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703296:0@lo:501: 00000100:00100000:1.0:1789265296.347246:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265296.347279:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409a7ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265296.347455:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553703296 00000100:00100000:3.0:1789265296.347461:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553703296 00000100:00100000:3.0:1789265296.347488:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265296.347496:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703296:12345-0@lo:501: 00000100:00100000:3.0:1789265296.348636:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703296:12345-0@lo:501: Request processed in 1135us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.348647:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265296.356731:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703296:0@lo:501: 00000100:00100000:0.0:1789265296.357472:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703424:0@lo:503: 00000100:00100000:0.0:1789265296.357590:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.357640:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265296.357651:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553703424 00000100:00100000:3.0:1789265296.357660:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553703424 00000100:00100000:3.0:1789265296.357721:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265296.357730:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703424:12345-0@lo:503: 00000100:00100000:3.0:1789265296.357956:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703424:12345-0@lo:503: Request processed in 226us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.357965:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789265296.358851:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703424:0@lo:503: 00000040:00080000:0.0:1789265296.359154:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265296.359220:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703552:0@lo:502: 00000100:00100000:0.0:1789265296.359274:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.359319:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265296.360702:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553703552 00000100:00100000:3.0:1789265296.360714:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553703552 00000100:00100000:3.0:1789265296.360779:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265296.360802:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703552:12345-0@lo:502: 00000100:00100000:3.0:1789265296.361051:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703552:12345-0@lo:502: Request processed in 249us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.361059:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265296.362166:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703552:0@lo:502: 00000040:00080000:0.0:1789265296.363000:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789265296.363074:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789265296.363104:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789265296.363144:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789265296.363197:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789265296.363246:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789265296.363283:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789265296.363316:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789265296.363408:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789265296.363439:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789265296.363466:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789265296.365816:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789265296.365939:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789265296.365979:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789265296.366035:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789265296.366088:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789265296.366121:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789265296.366167:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789265296.366200:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789265296.366230:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789265296.366349:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789265296.366393:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789265296.366429:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789265296.366473:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789265296.367912:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789265296.367987:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789265296.368058:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789265296.368097:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789265296.368150:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703680:0@lo:502: 00000100:00100000:0.0:1789265296.369104:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.369470:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405c62300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.371108:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553703680 00000100:00100000:1.0:1789265296.371123:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553703680 00000100:00100000:1.0:1789265296.371229:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265296.371242:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703680:12345-0@lo:502: 00000100:00100000:1.0:1789265296.371608:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703680:12345-0@lo:502: Request processed in 368us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.371617:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265296.371727:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703680:0@lo:502: 00000040:00080000:0.0:1789265296.371854:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789265296.371869:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789265296.372699:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789265296.372714:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff925402d719b8) 00000020:00000080:0.0:1789265296.372736:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789265296.372818:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92543b68a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265296.372822:0:6699:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92543b68a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265296.372825:0:6699:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92543b68a800 3 00010000:00080000:0.0:1789265296.372851:0:6699:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9253048c5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.143@tcp at head 00010000:00010000:0.0:1789265296.374466:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789265296.374694:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789265296.374728:0:6699:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265296.374741:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8e12577ef818f28b 00000100:00080000:0.0:1789265296.374760:0:6699:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265296.374767:0:6699:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9253048c5000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1789265296.374815:0:6699:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92540353df80 x1876180553703808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265296.374836:0:6699:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789265296.375998:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876180553703808:0@lo:38: 00000100:00100000:2.0:1789265296.376089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.378208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553703808 00000100:00100000:0.0:1789265296.378225:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553703808 00000100:00100000:0.0:1789265296.378353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265296.378363:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876180553703808:12345-0@lo:38: 00010000:00080000:0.0:1789265296.378396:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1789265296.378461:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8e12577ef818f292 00000004:00100000:0.0:1789265296.378482:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789265296.378519:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9253050fb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265296.378628:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876180553703808:12345-0@lo:38: Request processed in 265us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.378636:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789265296.379202:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92540353df80 x1876180553703808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265296.379215:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265296.379224:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789265296.379233:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265296.379238:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265296.379241:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9253048c5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265296.379247:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876180553703808:0@lo:38: 00000040:00080000:3.0:1789265296.380599:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789265296.384120:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789265296.384244:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265296.384278:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.384292:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789265296.384378:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789265296.384380:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265296.384381:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265296.384383:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265296.384384:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265296.384385:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265296.384387:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265296.384388:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265296.384390:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265296.384392:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265296.384393:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265296.384398:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789265296.384401:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265296.384402:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265296.384403:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265296.384404:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265296.384405:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265296.384406:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265296.384408:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265296.384409:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265296.384410:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265296.384411:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265296.384412:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265296.385035:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789265296.385060:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703936:0@lo:253: 00000100:00100000:2.0:1789265296.385211:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265296.385261:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254036f09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.385544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553703936 00000100:00100000:1.0:1789265296.385553:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553703936 00000100:00100000:1.0:1789265296.385611:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265296.385621:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:6676:x1876180553703936:12345-0@lo:253: 20000000:01000000:1.0:1789265296.385649:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789265296.385663:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789265296.446428:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789265296.446448:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789265296.446686:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265296.446692:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265296.446714:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.446733:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254027dee00/0x8e12577ef818f1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.446741:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.446783:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254027dee00/0x8e12577ef818f1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.446819:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9254027dee00/0x8e12577ef818f1f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 13 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.446834:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876180553704064:0@lo:104: 00000100:00100000:0.0:1789265296.446896:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265296.447014:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254028a0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.447152:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553704064 00000100:00100000:1.0:1789265296.447160:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553704064 00000100:00100000:1.0:1789265296.447203:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265296.447211:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5849:x1876180553704064:12345-0@lo:104: 00010000:00010000:1.0:1789265296.447223:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.447281:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265296.447288:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5849:x1876180553704064:12345-0@lo:104: Request processed in 77us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.447295:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265296.449111:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876180553704064:0@lo:104: 00010000:00010000:0.0:1789265296.449153:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.449175:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265296.449182:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.449190:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207c400 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:0.0:1789265296.449195:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.449204:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265296.449211:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265296.449218:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265296.449378:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f1ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.449385:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265296.449429:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f1ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.449435:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f1ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f1f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.449452:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265296.449454:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265296.449456:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265296.449475:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553704192:0@lo:103: 00000100:00100000:0.0:1789265296.449611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265296.449728:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553704192 00000100:00100000:3.0:1789265296.449735:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553704192 00010000:00010000:3.0:1789265296.449762:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254027dee00/0x8e12577ef818f1f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 14 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.449797:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265296.449805:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:3305:x1876180553704192:12345-0@lo:103: 00010000:00010000:3.0:1789265296.449816:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265296.449821:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254027dee00/0x8e12577ef818f1f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 14 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449832:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254027dee00/0x8e12577ef818f1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 14 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449845:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027dee00/0x8e12577ef818f1f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f1ea expref: 14 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449868:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449878:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265296.449893:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003201731s 00010000:00010000:3.0:1789265296.449898:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449904:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449911:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449917:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449922:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265296.449926:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449933:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449948:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.449957:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265296.450010:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3305:x1876180553704192:12345-0@lo:103: Request processed in 205us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.450018:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789265296.450066:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.450074:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.450080:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400030400/0x8e12577ef818f299 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.450110:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553704192:0@lo:103: 00000100:00100000:1.0:1789265296.458508:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:6676:x1876180553703936:12345-0@lo:253: Request processed in 72871us (73279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.458522:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789265296.458711:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:6676:1876180553703936:0@lo:253: 10000000:01000000:2.0:1789265296.458727:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789265296.458731:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265296.458733:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265296.458734:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265296.458735:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265296.458737:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265296.458738:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265296.458739:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265296.458741:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265296.458742:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265296.458744:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265296.458745:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789265296.458764:0:6676:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789265296.469278:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265296.469710:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789265296.471267:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265296.471709:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789265296.471966:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265296.472740:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789265296.474765:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789265296.747991:0:6676:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789265296.747999:0:6676:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789265296.748040:0:6676:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265296.748109:0:6676:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265296.748140:0:6676:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789265296.748170:0:6676:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789265296.927505:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265297.951744:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265298.974860:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265299.999457:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265301.028468:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265301.407624:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553704576:0@lo:400: 00000100:00100000:0.0:1789265301.407700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265301.407797:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553704320:0@lo:400: 00000100:00100000:1.0:1789265301.407833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265301.407868:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265301.407874:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553704448:0@lo:400: 00000100:00100000:1.0:1789265301.407896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265301.407929:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553704576 00000100:00100000:1.0:1789265301.407936:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553704576 00000100:00100000:1.0:1789265301.407981:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553704448 00000100:00100000:1.0:1789265301.407984:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553704448 00000100:00100000:1.0:1789265301.408011:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265301.408019:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553704576:12345-0@lo:400: 00000100:00100000:1.0:1789265301.408085:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553704576:12345-0@lo:400: Request processed in 66us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265301.408092:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265301.408110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265301.408116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553704448:12345-0@lo:400: 00000100:00100000:1.0:1789265301.408148:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553704448:12345-0@lo:400: Request processed in 32us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265301.408154:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789265301.408196:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92540353f100 x1876180553704448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265301.408208:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553704448:0@lo:400: 00010000:00080000:1.0:1789265301.408241:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92540353ea00 x1876180553704576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265301.408249:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553704576:0@lo:400: 00000100:00100000:0.0:1789265301.408303:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553704320 00000100:00100000:0.0:1789265301.408307:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553704320 00000100:00100000:0.0:1789265301.408362:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265301.408370:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3306:x1876180553704320:12345-0@lo:400: 00000100:00100000:0.0:1789265301.408401:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3306:x1876180553704320:12345-0@lo:400: Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265301.408408:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789265301.408431:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265301.408618:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553704320:0@lo:400: 00010000:00010000:0.0:1789265302.048239:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265303.070513:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265303.186029:0:7044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789265304.094546:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265305.118570:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789265305.502508:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789265305.502517:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff925409ebd800 from 21 10000000:01000000:1.0:1789265305.502523:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265305.502588:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.502601:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.502628:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265305.502651:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553704704:0@lo:101: 00000100:00100000:1.0:1789265305.502726:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265305.503188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553704704 00000100:00100000:3.0:1789265305.503196:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553704704 00000100:00100000:3.0:1789265305.503252:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265305.503269:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5831:x1876180553704704:12345-0@lo:101: 00010000:00010000:3.0:1789265305.503282:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265305.503295:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f2a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265305.503319:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265305.503407:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265305.503416:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9254027de400, rc 0) 00000100:00100000:3.0:1789265305.503458:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553704704:12345-0@lo:101: Request processed in 192us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265305.503465:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265305.504271:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306987840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265305.504299:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553704704:0@lo:101: 00010000:00010000:1.0:1789265305.504315:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.504326:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265305.504659:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553704832:0@lo:501: 00000100:00100000:1.0:1789265305.504706:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.504739:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306987840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265305.505298:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553704832 00000100:00100000:3.0:1789265305.505305:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553704832 00000100:00100000:3.0:1789265305.505628:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265305.505639:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553704832:12345-0@lo:501: 00000100:00100000:3.0:1789265305.506115:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553704832:12345-0@lo:501: Request processed in 477us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265305.506124:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265305.510110:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553704832:0@lo:501: 00000100:00100000:2.0:1789265305.510189:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553704960:0@lo:503: 00000100:00100000:2.0:1789265305.510272:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265305.510308:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9253050e9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265305.510684:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553704960 00000100:00100000:0.0:1789265305.510698:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553704960 00000100:00100000:0.0:1789265305.510762:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265305.510772:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553704960:12345-0@lo:503: 00000100:00100000:0.0:1789265305.511115:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553704960:12345-0@lo:503: Request processed in 343us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265305.511124:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265305.511307:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553704960:0@lo:503: 00000100:00100000:0.0:1789265305.514889:0:7148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7148:1876180553705088:0@lo:502: 00000100:00100000:0.0:1789265305.514986:0:7148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.515114:0:7148:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306b5c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265305.515627:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553705088 00000100:00100000:1.0:1789265305.515636:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553705088 00000100:00100000:1.0:1789265305.515734:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265305.515743:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7148:x1876180553705088:12345-0@lo:502: 00000100:00100000:1.0:1789265305.516140:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7148:x1876180553705088:12345-0@lo:502: Request processed in 397us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.516148:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265305.516624:0:7148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7148:1876180553705088:0@lo:502: 00000100:00100000:2.0:1789265305.516692:0:7148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7148:1876180553705216:0@lo:502: 00000100:00100000:2.0:1789265305.516734:0:7148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265305.516884:0:7148:0:(client.c:2715:ptlrpc_set_wait()) set ffff9253050e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265305.517001:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553705216 00000100:00100000:1.0:1789265305.517007:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553705216 00000100:00100000:1.0:1789265305.517044:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265305.517051:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7148:x1876180553705216:12345-0@lo:502: 00000100:00100000:1.0:1789265305.517249:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7148:x1876180553705216:12345-0@lo:502: Request processed in 198us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.517257:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265305.517407:0:7148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7148:1876180553705216:0@lo:502: 00000040:00080000:2.0:1789265305.517432:0:7148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789265305.518444:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789265305.518474:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265305.518485:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.518496:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265305.518507:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265305.518509:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff925409ebd800 from 4 10000000:01000000:1.0:1789265305.518512:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265305.518721:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.518730:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.518741:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265305.518773:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705344:0@lo:101: 00000100:00100000:1.0:1789265305.518945:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.518991:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265305.519116:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553705344 00000100:00100000:0.0:1789265305.519124:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553705344 00000100:00100000:0.0:1789265305.519172:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265305.519182:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553705344:12345-0@lo:101: 00010000:00010000:0.0:1789265305.519194:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265305.519208:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f2ae expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.519231:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.519242:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.519250:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925400031800, rc 0) 00000100:00100000:0.0:1789265305.519287:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553705344:12345-0@lo:101: Request processed in 107us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265305.519293:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265305.522426:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705344:0@lo:101: 00010000:00010000:1.0:1789265305.522458:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.522496:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265305.522788:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705472:0@lo:256: 00000100:00100000:1.0:1789265305.522982:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.523032:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306987d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265305.523949:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553705472 00000100:00100000:2.0:1789265305.523959:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553705472 00000100:00100000:2.0:1789265305.524009:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265305.524017:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553705472:12345-0@lo:256: 20000000:01000000:2.0:1789265305.524041:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265305.524066:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265305.524069:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789265305.524228:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553705472:12345-0@lo:256: Request processed in 211us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.524236:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789265305.524371:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705472:0@lo:256: 10000000:01000000:0.0:1789265305.524456:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265305.524464:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.524475:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265305.524484:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789265305.524487:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789265305.524490:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265305.524518:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.524525:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.524534:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265305.524765:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705600:0@lo:101: 00000100:00100000:0.0:1789265305.524801:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.524909:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306b5c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265305.524991:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553705600 00000100:00100000:1.0:1789265305.524996:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553705600 00000100:00100000:1.0:1789265305.525022:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265305.525029:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553705600:12345-0@lo:101: 00010000:00010000:1.0:1789265305.525040:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265305.525053:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f2bc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.525076:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.525086:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.525094:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207c600, rc 0) 00000100:00100000:1.0:1789265305.525134:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553705600:12345-0@lo:101: Request processed in 105us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.525139:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789265305.525996:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705600:0@lo:101: 00010000:00010000:0.0:1789265305.526016:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.526027:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265305.526112:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705728:0@lo:501: 00000100:00100000:0.0:1789265305.526151:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.526184:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306b5c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265305.526558:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553705728 00000100:00100000:1.0:1789265305.526565:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553705728 00000100:00100000:1.0:1789265305.526604:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265305.526612:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553705728:12345-0@lo:501: 00000100:00100000:1.0:1789265305.528032:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553705728:12345-0@lo:501: Request processed in 1413us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.528042:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265305.529310:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705728:0@lo:501: 00000100:00100000:0.0:1789265305.529419:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705856:0@lo:503: 00000100:00100000:0.0:1789265305.529478:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.529515:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306b5c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265305.529993:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553705856 00000100:00100000:2.0:1789265305.530001:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553705856 00000100:00100000:2.0:1789265305.530057:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265305.530067:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553705856:12345-0@lo:503: 00000100:00100000:2.0:1789265305.530327:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553705856:12345-0@lo:503: Request processed in 261us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.530376:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265305.531180:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553705856:0@lo:503: 00000100:00100000:1.0:1789265305.531988:0:7149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7149:1876180553705984:0@lo:502: 00000100:00100000:1.0:1789265305.532045:0:7149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.532085:0:7149:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306987000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265305.532178:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553705984 00000100:00100000:2.0:1789265305.532185:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553705984 00000100:00100000:2.0:1789265305.532231:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265305.532240:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:7149:x1876180553705984:12345-0@lo:502: 00000100:00100000:2.0:1789265305.532642:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:7149:x1876180553705984:12345-0@lo:502: Request processed in 402us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.532650:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265305.532985:0:7149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7149:1876180553705984:0@lo:502: 00000020:01000000:1.0:1789265305.533013:0:7149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265305.533021:0:7149:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789265305.533027:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265305.533029:0:7149:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789265305.533034:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789265305.533037:0:7149:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.143@tcp to nid 0x20000c0a8cc8f (192.168.204.143@tcp) 00000020:01000000:1.0:1789265305.533060:0:7149:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789265305.533063:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265305.533078:0:7149:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9254373c4d28) 00000020:00000080:1.0:1789265305.533096:0:7149:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789265305.533102:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789265305.533174:0:7149:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789265305.533180:0:7149:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789265305.533186:0:7149:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef818f2d1 00010000:00080000:1.0:1789265305.533212:0:7149:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92543b66f000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:1.0:1789265305.533485:0:7149:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789265305.646109:0:7149:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789265305.646133:0:7149:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789265305.647285:0:7149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265305.652045:0:7149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265305.652132:0:7149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789265305.652217:0:7149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789265305.659732:0:7151:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265305.659741:0:7151:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789265305.664712:0:7149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265305.664730:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789265305.664771:0:7149:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789265305.664793:0:7149:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef818f2d8 00000100:00080000:1.0:1789265305.664859:0:7149:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265305.664865:0:7149:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92543b66f000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1789265305.664901:0:7149:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9dc00 x1876180553706112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265305.664932:0:7149:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789265305.665034:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553706112:0@lo:8: 00000100:00100000:3.0:1789265305.665104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789265305.665250:0:7149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265305.665254:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265305.665256:0:7149:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789265305.665259:0:7149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265305.665262:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265305.665264:0:7149:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265305.665275:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265305.665277:0:7149:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789265305.665298:0:7149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7149:1876180553706240:0@lo:502: 00000100:00100000:1.0:1789265305.665371:0:7149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.665400:0:7149:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306987180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265305.665716:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553706112 00000100:00100000:2.0:1789265305.665723:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553706112 00000100:00100000:2.0:1789265305.665768:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265305.665775:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876180553706112:12345-0@lo:8: 00010000:00080000:2.0:1789265305.665807:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:2.0:1789265305.665833:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef818f2df 00002000:00100000:2.0:1789265305.665865:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff925304b50000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789265305.665869:0:6678:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789265305.665873:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789265305.665989:0:6678:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265305.666109:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265305.666137:0:6678:0:(import.c:65:import_set_state_nolock()) ffff925304b53000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265305.666205:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876180553706112:12345-0@lo:8: Request processed in 429us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.666212:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789265305.666600:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9dc00 x1876180553706112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265305.666612:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265305.666619:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789265305.666636:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789265305.666641:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789265305.666644:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b66f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789265305.666660:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789265305.666665:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553706112:0@lo:8: 00000100:00100000:3.0:1789265305.666701:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553706240 00000100:00100000:3.0:1789265305.666706:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553706240 00000100:00100000:3.0:1789265305.666736:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265305.666744:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:7149:x1876180553706240:12345-0@lo:502: 00000100:00100000:3.0:1789265305.666983:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:7149:x1876180553706240:12345-0@lo:502: Request processed in 240us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265305.666990:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265305.667046:0:7149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7149:1876180553706240:0@lo:502: 00000020:01000000:3.0:1789265305.667071:0:7149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265305.667077:0:7149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265305.667079:0:7149:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789265305.667083:0:7149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:3.0:1789265305.667236:0:7151:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265305.667684:0:7151:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 160901350909ns, next at 0ns, rc = 0 00000020:01000000:1.0:1789265305.668984:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789265305.669018:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265305.669030:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.669043:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265305.669073:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789265305.669076:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925402d54d28 from 1 10000000:01000000:1.0:1789265305.669078:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265305.669115:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.669123:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.669134:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265305.669158:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553706368:0@lo:101: 00000100:00100000:1.0:1789265305.669234:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.670899:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306987540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265305.677896:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553706368 00000100:00100000:0.0:1789265305.677915:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553706368 00000100:00100000:0.0:1789265305.677990:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265305.678002:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553706368:12345-0@lo:101: 00010000:00010000:0.0:1789265305.678019:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265305.678038:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.678069:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.678081:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265305.678090:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925400030a00, rc 0) 00000100:00100000:0.0:1789265305.679045:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553706368:12345-0@lo:101: Request processed in 1038us (9803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265305.679057:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265305.679204:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553706496:0@lo:400: 00000100:00100000:2.0:1789265305.679260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.679270:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553706624:0@lo:400: 00000100:00100000:1.0:1789265305.679313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.679392:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553706496 00000100:00100000:1.0:1789265305.679399:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553706496 00000100:00100000:1.0:1789265305.679434:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553706624 00000100:00100000:1.0:1789265305.679437:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553706624 00000100:00100000:1.0:1789265305.679469:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265305.679477:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553706496:12345-0@lo:400: 00000100:00100000:1.0:1789265305.679521:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553706496:12345-0@lo:400: Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.679528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265305.679542:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265305.679549:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553706624:12345-0@lo:400: 00000100:00100000:1.0:1789265305.679599:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553706624:12345-0@lo:400: Request processed in 52us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.679606:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789265305.679624:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265305.679650:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92540353f480 x1876180553706624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265305.679664:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553706624:0@lo:400: 00010000:00080000:1.0:1789265305.679719:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92540353df80 x1876180553706496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265305.679727:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553706496:0@lo:400: 00000100:00100000:1.0:1789265305.679752:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553706368:0@lo:101: 00010000:00010000:1.0:1789265305.679771:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265305.679783:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265305.679833:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553706752:0@lo:501: 00000100:00100000:1.0:1789265305.679866:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.679890:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306987540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265305.680684:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553706752 00000100:00100000:3.0:1789265305.680691:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553706752 00000100:00100000:3.0:1789265305.680728:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265305.680737:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553706752:12345-0@lo:501: 00000100:00100000:3.0:1789265305.681282:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553706752:12345-0@lo:501: Request processed in 545us (1420us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265305.681291:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265305.682456:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553706752:0@lo:501: 10000000:01000000:3.0:1789265305.682511:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789265305.682522:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265305.682533:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265305.765006:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789265305.818217:0:7152:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789265305.818252:0:7152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1876180553707008:0@lo:7: 00000100:00100000:0.0:1789265305.818481:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265305.818512:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553706880:0@lo:13: 00000100:00100000:0.0:1789265305.823944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265305.825639:0:7152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265305.825695:0:7152:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543ff34900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265305.825834:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553707008 00000100:00100000:0.0:1789265305.825845:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553707008 00000100:00100000:0.0:1789265305.826178:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265305.826190:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7152:x1876180553707008:12345-0@lo:7: 00000100:00100000:1.0:1789265305.826828:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553706880 00000100:00100000:1.0:1789265305.826837:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553706880 00000100:00100000:1.0:1789265305.826892:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265305.826903:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553706880:12345-0@lo:13: 00002000:00000024:1.0:1789265305.826930:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789265305.827032:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553706880:12345-0@lo:13: Request processed in 132us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.827041:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789265305.827574:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543be41500 x1876180553706880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265305.827711:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553706880:0@lo:13: 00000100:00080000:2.0:1789265305.829647:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789265305.833027:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789265305.833038:0:6681:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789265305.833236:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7152:x1876180553707008:12345-0@lo:7: Request processed in 7043us (7597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.833249:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265305.833987:0:7152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543be42a00 x1876180553707008/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265321 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265305.834005:0:7152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1876180553707008:0@lo:7: 00000004:00080000:3.0:1789265305.834021:0:7152:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789265305.834069:0:7152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1876180553707136:0@lo:5: 00000100:00100000:3.0:1789265305.834120:0:7152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265305.834246:0:7152:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543ff34900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265305.835108:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553707136 00000100:00100000:2.0:1789265305.835116:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553707136 00000100:00100000:2.0:1789265305.835215:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265305.835226:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7152:x1876180553707136:12345-0@lo:5: 00002000:00080000:2.0:1789265305.835259:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789265305.835263:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789265305.835698:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7152:x1876180553707136:12345-0@lo:5: Request processed in 473us (1576us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789265305.835720:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265305.835811:0:7152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543be42a00 x1876180553707136/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265321 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265305.835829:0:7152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1876180553707136:0@lo:5: 00000004:00080000:0.0:1789265305.835842:0:7152:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789265305.835876:0:7152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1876180553707264:0@lo:700: 00000100:00100000:0.0:1789265305.836381:0:7152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.836418:0:7152:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306b5c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265305.836508:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553707264 00000100:00100000:1.0:1789265305.836514:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553707264 00000100:00100000:1.0:1789265305.836553:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265305.836561:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7152:x1876180553707264:12345-0@lo:700: 00000100:00100000:1.0:1789265305.836600:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6687:1876180553707392:0@lo:700: 00000100:00100000:1.0:1789265305.836633:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.836654:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9253069876c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265305.836850:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553707392 00000100:00100000:3.0:1789265305.836855:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553707392 00000100:00100000:3.0:1789265305.837127:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265305.837137:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6687:x1876180553707392:12345-0@lo:700: 40000000:02000000:3.0:1789265305.931017:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789265305.936552:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6687:x1876180553707392:12345-0@lo:700: Request processed in 99406us (99906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265305.936569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789265305.936862:0:6687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9e680 x1876180553707392/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265321 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265305.936880:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6687:1876180553707392:0@lo:700: 40000000:02000000:1.0:1789265305.936894:0:6687:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1789265306.006043:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789265306.006064:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789265306.006483:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7152:x1876180553707264:12345-0@lo:700: Request processed in 169918us (170098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265306.006497:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265306.006600:0:7152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92540353ca80 x1876180553707264/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265321 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265306.006613:0:7152:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789265306.006632:0:7152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1876180553707264:0@lo:700: 00000004:02000040:3.0:1789265306.058044:0:7152:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789265306.069773:0:7152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1876180553707520:0@lo:5: 00000100:00100000:3.0:1789265306.070195:0:7152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265306.070281:0:7152:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543ff340c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265306.070670:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553707520 00000100:00100000:2.0:1789265306.070680:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553707520 00000100:00100000:2.0:1789265306.070741:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265306.070750:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7152:x1876180553707520:12345-0@lo:5: 00002000:00080000:2.0:1789265306.080120:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789265306.080148:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789265306.088814:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7152:x1876180553707520:12345-0@lo:5: Request processed in 18043us (18598us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789265306.088830:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789265306.093148:0:7152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543be43800 x1876180553707520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265306.093170:0:7152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1876180553707520:0@lo:5: 00000004:00080000:3.0:1789265306.093190:0:7152:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789265306.144191:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265307.167847:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789265308.133550:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789265308.194029:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265309.216570:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265310.243474:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265311.135950:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265311.135988:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553707648:0@lo:13: 00000100:00100000:2.0:1789265311.136073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265311.136164:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553707648 00000100:00100000:2.0:1789265311.136174:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553707648 00000100:00100000:2.0:1789265311.136240:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265311.136264:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553707648:12345-0@lo:13: 00002000:00000024:2.0:1789265311.136304:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265311.136369:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553707648:12345-0@lo:13: Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265311.136376:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789265311.136397:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265311.136426:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543b9dd880 x1876180553707648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265311.136436:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789265311.136458:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553707648:0@lo:13: 00000100:00100000:2.0:1789265311.141052:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553707904:0@lo:400: 00000100:00100000:2.0:1789265311.141139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265311.141178:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265311.141186:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553708032:0@lo:400: 00000100:00100000:2.0:1789265311.141210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265311.141275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553707904 00000100:00100000:2.0:1789265311.141283:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553707904 00000100:00100000:2.0:1789265311.141326:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553708032 00000100:00100000:2.0:1789265311.141329:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553708032 00000100:00100000:2.0:1789265311.141382:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265311.141390:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553707904:12345-0@lo:400: 00000100:00100000:2.0:1789265311.141442:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553707904:12345-0@lo:400: Request processed in 52us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265311.141449:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265311.141468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265311.141475:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553708032:12345-0@lo:400: 00000100:00100000:2.0:1789265311.141502:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553708032:12345-0@lo:400: Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265311.141508:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789265311.141531:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265311.141557:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543b9dfb80 x1876180553708032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265311.141570:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553708032:0@lo:400: 00010000:00080000:2.0:1789265311.141581:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543b9ded80 x1876180553707904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265311.141589:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553707904:0@lo:400: 00000100:00100000:3.0:1789265311.141871:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553707776:0@lo:400: 00000100:00100000:3.0:1789265311.141910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265311.142944:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553707776 00000100:00100000:2.0:1789265311.142977:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553707776 00000100:00100000:2.0:1789265311.143026:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265311.143035:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:3305:x1876180553707776:12345-0@lo:400: 00000100:00100000:2.0:1789265311.143106:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:3305:x1876180553707776:12345-0@lo:400: Request processed in 72us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265311.143114:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265311.143844:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553707776:0@lo:400: 00010000:00010000:1.0:1789265311.263376:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265312.287469:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265313.312419:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.334638:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789265314.598999:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789265314.599003:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789265314.599154:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9253050fe800 00000020:01000004:0.0:1789265314.599173:0:7614:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789265314.599196:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789265314.599213:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff925402d70000) 00000020:00000080:0.0:1789265314.599242:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789265314.613874:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789265314.614165:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789265314.634421:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789265314.639792:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789265314.639841:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789265314.639909:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789265314.639939:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789265314.640442:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789265314.640454:0:7614:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789265314.640466:0:7614:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8e12577ef818f2fb 00000020:01000004:3.0:1789265314.640474:0:7614:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789265314.640497:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789265314.640509:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789265314.640516:0:7614:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789265314.640540:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789265314.640545:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789265314.672074:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789265314.672111:0:7614:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.143@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789265314.672115:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789265314.672117:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265314.672118:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265314.672120:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265314.672121:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265314.672123:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265314.672124:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265314.672126:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265314.672127:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265314.672129:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265314.672130:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789265314.672133:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789265314.672135:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265314.672137:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265314.672138:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265314.672139:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265314.672140:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265314.672141:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265314.672142:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265314.672143:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265314.672144:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265314.672145:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265314.672146:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789265314.672171:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789265314.672275:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553708160:0@lo:253: 00000100:00100000:2.0:1789265314.672601:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.672748:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b9d8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.672799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553708160 00000100:00100000:3.0:1789265314.672806:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553708160 00000100:00100000:3.0:1789265314.672889:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265314.672898:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:7614:x1876180553708160:12345-0@lo:253: 20000000:01000000:3.0:1789265314.672927:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789265314.672931:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789265314.672935:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789265314.672939:0:5828:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789265314.674001:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265314.674237:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789265314.674255:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789265314.674307:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789265314.674316:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789265314.674377:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789265314.674429:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789265314.675113:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789265314.675136:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.143@tcp 20000000:01000000:3.0:1789265314.675138:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:3.0:1789265314.675176:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789265314.675198:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789265314.675248:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789265314.675256:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:3.0:1789265314.675283:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789265314.675291:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789265314.675317:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789265314.675475:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789265314.676974:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789265314.677006:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.143@tcp 20000000:01000000:0.0:1789265314.677009:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789265314.677044:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789265314.677051:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789265314.677078:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789265314.677087:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:0.0:1789265314.677116:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789265314.677125:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789265314.677163:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789265314.677313:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789265314.677499:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789265314.677503:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789265314.677512:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789265314.677513:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789265314.677516:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789265314.677531:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789265314.677535:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789265314.677572:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789265314.677574:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789265314.678237:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789265314.678763:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789265314.678824:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789265314.678889:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789265314.678901:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789265314.678903:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265314.679504:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265314.679566:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265314.679620:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789265314.679970:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789265314.680007:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789265314.680057:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789265314.680238:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789265314.680241:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265314.681223:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265314.681291:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265314.681485:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789265314.684094:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789265314.684241:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789265314.684286:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789265314.684309:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789265314.684312:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265314.685725:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265314.685817:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265314.685878:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789265314.686229:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789265314.686273:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789265314.686409:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1789265314.686430:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789265314.686451:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686468:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f24c expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686476:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f276 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686483:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686490:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686497:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686503:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686549:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686579:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 16 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.686596:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708288:0@lo:104: 00000100:00100000:0.0:1789265314.686751:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265314.686859:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686868:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 16 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.686877:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708416:0@lo:104: 00010000:00010000:0.0:1789265314.686918:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686926:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 16 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.686934:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708544:0@lo:104: 00010000:00010000:0.0:1789265314.686974:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f276 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.686982:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f276 expref: 16 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.686989:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708672:0@lo:104: 00010000:00010000:0.0:1789265314.687013:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f24c expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.687030:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f24c expref: 16 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.687038:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708800:0@lo:104: 00000100:00100000:0.0:1789265314.687059:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437286f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265314.687299:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265314.687319:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.687429:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.687569:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265314.687595:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553708288 00000100:00100000:0.0:1789265314.687602:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553708288 00000100:00100000:0.0:1789265314.687710:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553708416 00000100:00100000:0.0:1789265314.687715:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553708416 00000100:00100000:0.0:1789265314.687728:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553708544 00000100:00100000:0.0:1789265314.687731:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553708544 00000100:00100000:0.0:1789265314.687745:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265314.687754:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403e15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:5828:x1876180553708288:12345-0@lo:104: 00010000:00010000:0.0:1789265314.687769:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.687892:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265314.687898:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403e15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:5828:x1876180553708288:12345-0@lo:104: Request processed in 145us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.687905:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265314.687948:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265314.687954:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:5828:x1876180553708416:12345-0@lo:104: 00010000:00010000:0.0:1789265314.687961:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.687993:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265314.687998:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:5828:x1876180553708416:12345-0@lo:104: Request processed in 45us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.688013:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265314.688026:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265314.688032:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5828:x1876180553708544:12345-0@lo:104: 00010000:00010000:0.0:1789265314.688039:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.688067:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789265314.688071:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5828:x1876180553708544:12345-0@lo:104: Request processed in 40us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.688077:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789265314.688135:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265314.688142:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688149:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207c400 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265314.688153:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688162:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265314.688169:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265314.688174:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265314.688231:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688237:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265314.688257:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688264:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92544207c400/0x8e12577ef818f2e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688286:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265314.688289:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688294:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265314.688297:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688303:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265314.688309:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265314.688314:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265314.688327:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688359:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265314.688365:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688371:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030600/0x8e12577ef818f2bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688383:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265314.688386:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688401:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207da00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265314.688405:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688411:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265314.688417:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265314.688422:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265314.688437:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688442:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265314.688457:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688463:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92544207da00/0x8e12577ef818f2a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2a7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688475:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.688477:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.688478:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.688485:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265314.688499:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553708928:0@lo:103: 00000100:00100000:3.0:1789265314.688534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.688566:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265314.688572:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553709056:0@lo:103: 00000100:00100000:3.0:1789265314.688600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.688641:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553709184:0@lo:103: 00000100:00100000:3.0:1789265314.688663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.688697:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553708928 00000100:00100000:3.0:1789265314.688702:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553708928 00010000:00010000:3.0:1789265314.688722:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 17 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.688738:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553709056 00000100:00100000:3.0:1789265314.688741:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553709056 00010000:00010000:3.0:1789265314.688751:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 18 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.688761:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553709184 00000100:00100000:3.0:1789265314.688764:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553709184 00010000:00010000:3.0:1789265314.688774:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 19 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.688786:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265314.688792:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553708928:12345-0@lo:103: 00010000:00010000:3.0:1789265314.688803:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265314.688808:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 19 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688817:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 19 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688834:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265314.688864:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553708928:12345-0@lo:103: Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.688880:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265314.688897:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265314.688903:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:3304:x1876180553709056:12345-0@lo:103: 00010000:00010000:3.0:1789265314.688910:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265314.688914:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 18 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688922:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 18 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688933:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265314.688956:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:3304:x1876180553709056:12345-0@lo:103: Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.688962:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265314.688972:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265314.688978:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:3306:x1876180553709184:12345-0@lo:103: 00010000:00010000:3.0:1789265314.688984:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265314.688988:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 17 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.688996:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 17 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.689006:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265314.689030:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:3306:x1876180553709184:12345-0@lo:103: Request processed in 52us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.689036:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265314.689077:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553709184:0@lo:103: 00000100:00100000:3.0:1789265314.689114:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553709056:0@lo:103: 00000100:00100000:3.0:1789265314.689121:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553708928:0@lo:103: 00000100:00100000:2.0:1789265314.689436:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265314.689514:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400030a00/0x8e12577ef818f2ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f2e6 expref: 16 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.689543:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708288:0@lo:104: 00010000:00010000:1.0:1789265314.689555:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207c600/0x8e12577ef818f2c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f2bc expref: 15 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.689565:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708416:0@lo:104: 00010000:00010000:1.0:1789265314.689573:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027de400/0x8e12577ef818f2a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f2a0 expref: 14 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.689582:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708544:0@lo:104: 00000100:00100000:0.0:1789265314.689765:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553708672 00000100:00100000:0.0:1789265314.689771:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553708672 00000100:00100000:0.0:1789265314.689793:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553708800 00000100:00100000:0.0:1789265314.689796:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553708800 00000100:00100000:0.0:1789265314.689808:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265314.689815:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:5828:x1876180553708672:12345-0@lo:104: 00010000:00010000:0.0:1789265314.689825:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.689920:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265314.689926:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:5828:x1876180553708672:12345-0@lo:104: Request processed in 112us (2357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.689932:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265314.689945:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265314.689951:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5828:x1876180553708800:12345-0@lo:104: 00010000:00010000:0.0:1789265314.689969:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.690015:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265314.690020:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5828:x1876180553708800:12345-0@lo:104: Request processed in 70us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.690026:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789265314.690080:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265314.690086:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690094:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265314.690097:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690106:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265314.690112:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265314.690118:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265314.690153:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690159:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265314.690173:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690188:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f27d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690199:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265314.690203:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690214:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207c800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265314.690217:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690224:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265314.690230:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265314.690235:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265314.690250:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690256:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265314.690267:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690273:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92544207c800/0x8e12577ef818f24c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f253 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.690289:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.690290:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.690293:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265314.690305:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553709312:0@lo:103: 00000100:00100000:3.0:1789265314.690441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.690674:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553709440:0@lo:103: 00000100:00100000:2.0:1789265314.690703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265314.690741:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265314.690766:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553709312 00000100:00100000:2.0:1789265314.690771:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553709312 00010000:00010000:2.0:1789265314.690796:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f276 expref: 14 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265314.690817:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553709440 00000100:00100000:2.0:1789265314.690820:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553709440 00010000:00010000:2.0:1789265314.690851:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f24c expref: 15 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265314.690865:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265314.690873:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:3307:x1876180553709312:12345-0@lo:103: 00010000:00010000:2.0:1789265314.690883:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265314.690887:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f276 expref: 15 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.690896:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f276 expref: 15 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.690911:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265314.690939:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:3307:x1876180553709312:12345-0@lo:103: Request processed in 68us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.690945:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265314.690971:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265314.690978:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:3304:x1876180553709440:12345-0@lo:103: 00010000:00010000:2.0:1789265314.690986:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265314.690990:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f24c expref: 14 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.690999:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f24c expref: 14 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691012:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691021:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691036:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691044:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691052:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691059:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691064:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265314.691070:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691078:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691094:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.691104:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265314.691132:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:3304:x1876180553709440:12345-0@lo:103: Request processed in 155us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.691139:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265314.691169:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553709440:0@lo:103: 00000100:00100000:2.0:1789265314.691225:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553709312:0@lo:103: 00010000:00010000:1.0:1789265314.691366:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027de200/0x8e12577ef818f27d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f276 expref: 13 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.691387:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708672:0@lo:104: 00010000:00010000:1.0:1789265314.691414:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137c00/0x8e12577ef818f253 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f24c expref: 12 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.691421:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1876180553708800:0@lo:104: 00010000:00010000:1.0:1789265314.691444:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.691452:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.691458:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.691463:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400030400/0x8e12577ef818f302 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265314.691485:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789265314.724035:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:7614:x1876180553708160:12345-0@lo:253: Request processed in 51126us (51422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.724050:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265314.724167:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553708160:0@lo:253: 10000000:01000000:3.0:1789265314.724195:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789265314.724215:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265314.724217:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265314.724218:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265314.724219:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789265314.724221:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265314.724222:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265314.724224:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265314.724225:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789265314.724227:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265314.724228:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265314.724255:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9253050fe800 from lustre-OST0001 10000000:01000000:3.0:1789265314.724286:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789265314.724289:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265314.724298:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff925402d54d28 local copy 10000000:01000000:3.0:1789265314.724302:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789265314.724377:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.724389:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.724399:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.724417:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553709568:0@lo:101: 00000100:00100000:3.0:1789265314.724455:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.724488:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265314.724555:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553709568 00000100:00100000:1.0:1789265314.724563:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553709568 00000100:00100000:1.0:1789265314.724607:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789265314.724615:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:7614:x1876180553709568:12345-0@lo:101: 00010000:00010000:1.0:1789265314.724639:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265314.724652:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207c600/0x8e12577ef818f310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f309 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.724676:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207c600/0x8e12577ef818f310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f309 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.724688:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207c600/0x8e12577ef818f310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f309 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.724697:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207c600, rc 0) 00000100:00100000:1.0:1789265314.724727:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553709568:12345-0@lo:101: Request processed in 113us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.724734:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265314.725481:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553709568:0@lo:101: 00010000:00010000:3.0:1789265314.725501:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.725512:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.725661:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553709696:0@lo:501: 00000100:00100000:3.0:1789265314.725699:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.725740:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.725850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553709696 00000100:00100000:0.0:1789265314.725857:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553709696 00000100:00100000:0.0:1789265314.725895:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265314.725904:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553709696:12345-0@lo:501: 00000100:00100000:0.0:1789265314.726144:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553709696:12345-0@lo:501: Request processed in 241us (443us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265314.726151:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265314.726788:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553709696:0@lo:501: 10000000:01000000:3.0:1789265314.726807:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789265314.726843:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789265314.726850:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.726861:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.726868:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.726897:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789265314.726920:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9253050fe800 10000000:01000000:3.0:1789265314.726925:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265314.726931:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265314.726934:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265314.726938:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789265314.726941:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789265314.726966:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.726974:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.726998:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.727013:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553709824:0@lo:101: 00000100:00100000:3.0:1789265314.727049:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.727084:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41900 going to sleep for 11 seconds 00010000:00010000:0.0:1789265314.727139:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265314.727145:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.727154:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027df800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:0.0:1789265314.727158:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.727166:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265314.727173:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265314.727188:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265314.727211:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.727230:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265314.727259:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.727266:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254027df800/0x8e12577ef818f309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e12577ef818f310 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.727281:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265314.727283:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265314.727285:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265314.727292:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265314.727305:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553709952:0@lo:103: 00000100:00100000:0.0:1789265314.727377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265314.727412:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553709952 00000100:00100000:0.0:1789265314.727417:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553709952 00000100:00100000:0.0:1789265314.727458:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265314.727465:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3304:x1876180553709952:12345-0@lo:103: 00010000:00010000:0.0:1789265314.727478:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265314.727492:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207c600/0x8e12577ef818f310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f309 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.727508:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265314.727541:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:3304:x1876180553709952:12345-0@lo:103: Request processed in 76us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.727548:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265314.727578:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553709952:0@lo:103: 00000100:00100000:1.0:1789265314.727645:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553709824 00000100:00100000:1.0:1789265314.727649:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553709824 00000100:00100000:1.0:1789265314.727680:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265314.727687:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+11:7614:x1876180553709824:12345-0@lo:101: 00010000:00010000:1.0:1789265314.727698:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265314.727716:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f317 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.727735:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f317 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.727745:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f317 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.727752:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207de00, rc 0) 00000100:00100000:1.0:1789265314.727783:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553709824:12345-0@lo:101: Request processed in 97us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.727789:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265314.727939:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553709824:0@lo:101: 00010000:00010000:3.0:1789265314.727950:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.727960:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.728044:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710080:0@lo:501: 00000100:00100000:3.0:1789265314.728071:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.728094:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.728144:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553710080 00000100:00100000:0.0:1789265314.728155:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553710080 00000100:00100000:0.0:1789265314.728193:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265314.728200:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710080:12345-0@lo:501: 00000100:00100000:0.0:1789265314.728451:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710080:12345-0@lo:501: Request processed in 250us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.728458:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265314.728529:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710080:0@lo:501: 00000100:00100000:3.0:1789265314.728560:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710208:0@lo:503: 00000100:00100000:3.0:1789265314.728601:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.728714:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553710208 00000100:00100000:1.0:1789265314.728719:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553710208 00000100:00100000:1.0:1789265314.728742:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265314.728749:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710208:12345-0@lo:503: 00000100:00100000:1.0:1789265314.728890:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710208:12345-0@lo:503: Request processed in 141us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.728896:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265314.728958:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.728973:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710208:0@lo:503: 00000040:00080000:3.0:1789265314.729266:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265314.729365:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710336:0@lo:502: 00000100:00100000:3.0:1789265314.729398:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.729419:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.729445:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553710336 00000100:00100000:3.0:1789265314.729449:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553710336 00000100:00100000:3.0:1789265314.729469:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265314.729474:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710336:12345-0@lo:502: 00000100:00100000:3.0:1789265314.729614:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710336:12345-0@lo:502: Request processed in 139us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.729621:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265314.729670:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710336:0@lo:502: 00000040:00080000:3.0:1789265314.729932:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789265314.729981:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789265314.730017:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789265314.730067:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789265314.730105:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789265314.730140:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789265314.730165:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710464:0@lo:502: 00000100:00100000:3.0:1789265314.730215:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.730232:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.730250:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553710464 00000100:00100000:3.0:1789265314.730254:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553710464 00000100:00100000:3.0:1789265314.730273:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265314.730280:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710464:12345-0@lo:502: 00000100:00100000:3.0:1789265314.730440:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710464:12345-0@lo:502: Request processed in 160us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.730447:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265314.730490:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710464:0@lo:502: 00000040:00080000:3.0:1789265314.730571:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789265314.730580:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789265314.731269:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265314.731277:0:7621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789265314.731284:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265314.731286:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789265314.731292:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265314.731307:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff925402d73370) 00000020:00000080:0.0:1789265314.731444:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789265314.731453:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789265314.731531:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9253050fe800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789265314.731539:0:7621:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789265314.731547:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8e12577ef818f32c 00010000:00010000:0.0:1789265314.736065:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789265314.736591:0:7621:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789265314.739862:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789265314.740272:0:7621:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789265314.745214:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789265314.745897:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789265314.747882:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789265314.747898:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265314.747908:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265314.747912:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789265314.747916:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265314.747922:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265314.747935:0:7621:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265314.747939:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265314.747941:0:7621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789265314.748008:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265314.748012:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265314.748013:0:7621:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789265314.748016:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789265314.754158:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789265314.754216:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789265314.754248:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.754261:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265314.754269:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9253050fe800 from 1 10000000:01000000:0.0:1789265314.754272:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265314.754357:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.754376:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.754387:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.754410:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710592:0@lo:101: 00000100:00100000:0.0:1789265314.754491:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265314.754533:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437286480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.754723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553710592 00000100:00100000:3.0:1789265314.754739:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553710592 00000100:00100000:3.0:1789265314.754842:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265314.754852:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:7614:x1876180553710592:12345-0@lo:101: 00010000:00010000:3.0:1789265314.754867:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265314.754880:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f333 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.754906:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f333 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.754916:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f333 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.754926:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9254027de000, rc 0) 00000100:00100000:3.0:1789265314.754972:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553710592:12345-0@lo:101: Request processed in 121us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.754979:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265314.757844:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710592:0@lo:101: 00010000:00010000:0.0:1789265314.757877:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.757890:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.758042:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710720:0@lo:501: 00000100:00100000:0.0:1789265314.758120:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265314.758221:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437286480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.758314:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553710720 00000100:00100000:3.0:1789265314.758321:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553710720 00000100:00100000:3.0:1789265314.758384:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265314.758396:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553710720:12345-0@lo:501: 00000100:00100000:3.0:1789265314.758713:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553710720:12345-0@lo:501: Request processed in 319us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.758722:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789265314.758983:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710720:0@lo:501: 00000100:00100000:0.0:1789265314.759019:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710848:0@lo:503: 00000100:00100000:0.0:1789265314.759061:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265314.759090:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437286480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.759135:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553710848 00000100:00100000:3.0:1789265314.759141:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553710848 00000100:00100000:3.0:1789265314.759215:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789265314.759223:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553710848:12345-0@lo:503: 00000100:00100000:3.0:1789265314.759602:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553710848:12345-0@lo:503: Request processed in 379us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.759618:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789265314.760091:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710848:0@lo:503: 00000040:00080000:3.0:1789265314.761034:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265314.761133:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710976:0@lo:502: 00000100:00100000:3.0:1789265314.761218:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.761296:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.761429:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553710976 00000100:00100000:0.0:1789265314.761437:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553710976 00000100:00100000:0.0:1789265314.761512:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789265314.761529:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553710976:12345-0@lo:502: 00000100:00100000:0.0:1789265314.761891:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553710976:12345-0@lo:502: Request processed in 363us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.761899:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265314.761990:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553710976:0@lo:502: 00000040:00080000:3.0:1789265314.762292:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789265314.762406:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789265314.762440:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711104:0@lo:502: 00000100:00100000:3.0:1789265314.762481:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.762774:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254071b63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265314.762887:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553711104 00000100:00100000:2.0:1789265314.762895:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553711104 00000100:00100000:2.0:1789265314.762942:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789265314.762951:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553711104:12345-0@lo:502: 00000100:00100000:2.0:1789265314.763171:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553711104:12345-0@lo:502: Request processed in 221us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.763192:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265314.763296:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711104:0@lo:502: 00000040:00080000:3.0:1789265314.763433:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789265314.763444:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789265314.764415:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265314.764426:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265314.764428:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265314.764434:0:7625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9253050fe800 00000020:00000080:3.0:1789265314.764437:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265314.764460:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265314.764463:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265314.764465:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789265314.764468:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789265314.764804:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789265314.764826:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265314.764877:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.764888:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265314.764932:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265314.764935:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9253050fe800 10000000:01000000:2.0:1789265314.764939:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9253050fe800 10000000:01000000:2.0:1789265314.764952:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265314.764958:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9253050fe800 from 1 10000000:01000000:2.0:1789265314.764960:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265314.764994:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.765003:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.765014:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265314.765033:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711232:0@lo:101: 00000100:00100000:2.0:1789265314.765083:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.765123:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b9d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265314.765138:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553711232 00000100:00100000:1.0:1789265314.765147:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553711232 00000100:00100000:1.0:1789265314.765199:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265314.765208:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553711232:12345-0@lo:101: 00010000:00010000:1.0:1789265314.765221:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265314.765236:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f341 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.765264:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f341 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.765274:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f341 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.765283:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207c600, rc 0) 00000100:00100000:1.0:1789265314.765328:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711232:12345-0@lo:101: Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.765373:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789265314.765516:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711232:0@lo:101: 00010000:00010000:2.0:1789265314.765530:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.765540:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265314.765693:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711360:0@lo:501: 00000100:00100000:2.0:1789265314.765738:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.765768:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b9d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265314.765825:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553711360 00000100:00100000:1.0:1789265314.765829:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553711360 00000100:00100000:1.0:1789265314.765896:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789265314.765904:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711360:12345-0@lo:501: 00000100:00100000:1.0:1789265314.766140:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711360:12345-0@lo:501: Request processed in 236us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.766154:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789265314.766233:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711360:0@lo:501: 00000100:00100000:2.0:1789265314.766263:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711488:0@lo:503: 00000100:00100000:2.0:1789265314.766304:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.767011:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b9d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.767086:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553711488 00000100:00100000:0.0:1789265314.767092:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553711488 00000100:00100000:0.0:1789265314.767121:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265314.767130:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711488:12345-0@lo:503: 00000100:00100000:0.0:1789265314.767329:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711488:12345-0@lo:503: Request processed in 199us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.767353:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265314.767446:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711488:0@lo:503: 00000040:00080000:2.0:1789265314.767753:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265314.767827:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711616:0@lo:502: 00000100:00100000:2.0:1789265314.767864:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.767893:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b9d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.768006:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553711616 00000100:00100000:0.0:1789265314.768011:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553711616 00000100:00100000:0.0:1789265314.768033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265314.768039:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711616:12345-0@lo:502: 00000100:00100000:0.0:1789265314.768228:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711616:12345-0@lo:502: Request processed in 188us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.768236:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789265314.768437:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711616:0@lo:502: 00000040:00080000:2.0:1789265314.768863:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789265314.768914:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789265314.768946:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789265314.768993:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789265314.769016:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789265314.769046:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789265314.769081:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789265314.769114:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789265314.769156:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789265314.769209:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789265314.769244:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789265314.769316:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789265314.769408:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789265314.769459:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789265314.769523:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789265314.769560:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789265314.771032:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789265314.771142:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789265314.771193:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789265314.771230:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789265314.771277:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789265314.773060:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789265314.773149:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789265314.773232:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789265314.773291:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789265314.773504:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789265314.773581:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789265314.773628:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789265314.773665:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789265314.773926:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789265314.773966:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789265314.773999:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789265314.774033:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789265314.774081:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789265314.774118:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789265314.774168:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789265314.774288:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789265314.774544:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711744:0@lo:502: 00000100:00100000:2.0:1789265314.774644:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.774743:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b9d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.774851:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553711744 00000100:00100000:0.0:1789265314.774860:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553711744 00000100:00100000:0.0:1789265314.774956:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265314.774967:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711744:12345-0@lo:502: 00000100:00100000:0.0:1789265314.775553:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553711744:12345-0@lo:502: Request processed in 586us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.775566:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789265314.775849:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553711744:0@lo:502: 00000040:00080000:2.0:1789265314.775945:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789265314.775959:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789265314.776922:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789265314.776938:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9254373c19b8) 00000020:00000080:1.0:1789265314.776960:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789265314.777048:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9253050fe800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789265314.777052:0:7626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9253050fe800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789265314.777055:0:7626:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9253050fe800 3 00010000:00080000:1.0:1789265314.777089:0:7626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92543b66d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.143@tcp at head 00010000:00010000:1.0:1789265314.779512:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789265314.779871:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789265314.779918:0:7626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265314.779934:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8e12577ef818f356 00000100:00080000:1.0:1789265314.779948:0:7626:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265314.779955:0:7626:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92543b66d800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1789265314.780006:0:7626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9e680 x1876180553711872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265314.780035:0:7626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789265314.780231:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876180553711872:0@lo:38: 00000100:00100000:3.0:1789265314.780321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789265314.780554:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1789265314.780833:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553711872 00000100:00100000:1.0:1789265314.780841:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553711872 00000100:00080000:3.0:1789265314.780897:0:7627:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff92543be42a00 x1876180553712000/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265314.780907:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254071b6b40 going to sleep for 0 seconds 00000100:00100000:2.0:1789265314.781048:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553712256:0@lo:400: 00000100:00100000:2.0:1789265314.781091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.781116:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265314.781121:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553712128:0@lo:400: 00000100:00100000:2.0:1789265314.781143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.781164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553712256 00000100:00100000:2.0:1789265314.781168:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553712256 00000100:00100000:2.0:1789265314.781215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553712128 00000100:00100000:2.0:1789265314.781219:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553712128 00000100:00100000:2.0:1789265314.781242:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265314.781252:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553712256:12345-0@lo:400: 00000100:00100000:2.0:1789265314.781315:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553712256:12345-0@lo:400: Request processed in 65us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.781324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265314.781370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265314.781378:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553712128:12345-0@lo:400: 00000100:00100000:2.0:1789265314.781404:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553712128:12345-0@lo:400: Request processed in 28us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.781409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265314.781421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265314.781425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876180553711872:12345-0@lo:38: 00010000:00080000:2.0:1789265314.781444:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1789265314.781475:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8e12577ef818f35d 00000004:00100000:2.0:1789265314.781494:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265314.781529:0:5835:0:(import.c:65:import_set_state_nolock()) ffff925441442000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265314.781568:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876180553711872:12345-0@lo:38: Request processed in 141us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.781574:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789265314.781591:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265314.781616:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543b9dd880 x1876180553712128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265314.781628:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553712128:0@lo:400: 00010000:00080000:2.0:1789265314.781638:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543b9df100 x1876180553712256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265314.781645:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553712256:0@lo:400: 00000020:01000000:2.0:1789265314.781671:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789265314.781714:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265314.781815:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781825:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789265314.781876:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789265314.781878:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265314.781879:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265314.781880:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265314.781881:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265314.781883:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265314.781884:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265314.781886:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265314.781887:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265314.781889:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265314.781890:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265314.781894:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789265314.781897:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265314.781899:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265314.781900:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265314.781901:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265314.781902:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265314.781903:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265314.781904:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265314.781905:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265314.781906:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265314.781908:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265314.781909:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265314.781925:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789265314.781935:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553712512:0@lo:253: 00000100:00100000:2.0:1789265314.781973:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.781989:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b9d8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.782104:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265314.782116:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553712384:0@lo:400: 00000100:00100000:3.0:1789265314.782149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789265314.782206:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9e680 x1876180553711872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265314.782215:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265314.782223:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789265314.782231:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265314.782235:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265314.782238:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b66d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789265314.782245:0:3303:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cee351c1): req@ffff92543be42a00 x1876180553712000/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265314.782260:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876180553711872:0@lo:38: 00000100:00100000:3.0:1789265314.782290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553712512 00000100:00100000:3.0:1789265314.782294:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553712512 00000100:00100000:3.0:1789265314.782325:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265314.782358:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:7614:x1876180553712512:12345-0@lo:253: 20000000:01000000:3.0:1789265314.782384:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789265314.782403:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789265314.783155:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553712384 00000100:00100000:3.0:1789265314.783164:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553712384 00000100:00100000:3.0:1789265314.783218:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265314.783226:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553712384:12345-0@lo:400: 00000100:00100000:3.0:1789265314.783290:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553712384:12345-0@lo:400: Request processed in 66us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.783305:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789265314.783380:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265314.783406:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543b9dc700 x1876180553712384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265314.783419:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553712384:0@lo:400: 00000100:00100000:3.0:1789265314.783476:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.783505:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553712000 00000100:00100000:3.0:1789265314.783509:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553712000 00000100:00100000:3.0:1789265314.783543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265314.783550:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7627:x1876180553712000:12345-0@lo:901: 00000100:00100000:3.0:1789265314.783925:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7627:x1876180553712000:12345-0@lo:901: Request processed in 375us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.783932:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789265314.783951:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789265314.783974:0:7627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543be42a00 x1876180553712000/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789265330 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265314.783984:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7627:1876180553712000:0@lo:901: 20000000:01000000:3.0:1789265314.811981:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789265314.812038:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789265314.812107:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265314.812113:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265314.812152:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.812172:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.812191:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.812236:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.812250:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 14 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.812265:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876180553712640:0@lo:104: 00000100:00100000:0.0:1789265314.812367:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265314.812465:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b3cd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265314.813467:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553712640 00000100:00100000:1.0:1789265314.813478:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553712640 00000100:00100000:1.0:1789265314.813568:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265314.813579:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5849:x1876180553712640:12345-0@lo:104: 00010000:00010000:1.0:1789265314.813596:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.813702:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265314.813708:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:5849:x1876180553712640:12345-0@lo:104: Request processed in 133us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.813810:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265314.813883:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1876180553712640:0@lo:104: 00010000:00010000:0.0:1789265314.813908:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818046:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265314.818064:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818080:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207d600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1789265314.818085:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818097:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265314.818105:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265314.818111:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265314.818167:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818185:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265314.818209:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818217:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f2ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f2b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818237:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.818239:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.818241:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265314.818259:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553712768:0@lo:103: 00000100:00100000:1.0:1789265314.818378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.818448:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553712768 00000100:00100000:1.0:1789265314.818457:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553712768 00010000:00010000:1.0:1789265314.818484:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 15 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.818516:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265314.818526:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:3305:x1876180553712768:12345-0@lo:103: 00010000:00010000:1.0:1789265314.818538:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265314.818543:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 15 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818555:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 15 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818570:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400031800/0x8e12577ef818f2b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f2ae expref: 15 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818585:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818593:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265314.818609:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006496307s 00010000:00010000:1.0:1789265314.818613:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818620:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818651:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818658:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818664:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265314.818668:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818676:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818692:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818702:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265314.818918:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:3305:x1876180553712768:12345-0@lo:103: Request processed in 392us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.818926:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789265314.818986:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.818995:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.819002:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400030400/0x8e12577ef818f364 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.819914:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553712768:0@lo:103: 00000100:00100000:0.0:1789265314.821226:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:7614:x1876180553712512:12345-0@lo:253: Request processed in 38887us (39246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.821238:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789265314.821321:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:7614:1876180553712512:0@lo:253: 10000000:01000000:2.0:1789265314.821445:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789265314.821463:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265314.821465:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265314.821467:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265314.821468:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265314.821469:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265314.821470:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265314.821472:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265314.821474:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265314.821475:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265314.821477:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265314.821478:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789265314.821501:0:7614:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789265314.827437:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265314.827834:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789265314.828065:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265314.828376:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789265314.828591:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265314.829001:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789265314.830416:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789265315.001093:0:7614:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789265315.001103:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789265315.001141:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789265315.001216:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789265315.001231:0:7614:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789265315.001263:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789265315.358549:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265316.254676:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265316.254702:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553712896:0@lo:13: 00000100:00100000:0.0:1789265316.254771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265316.254844:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553712896 00000100:00100000:0.0:1789265316.254858:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553712896 00000100:00100000:0.0:1789265316.254916:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265316.254926:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553712896:12345-0@lo:13: 00002000:00000024:0.0:1789265316.254960:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265316.255006:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553712896:12345-0@lo:13: Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265316.255014:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789265316.255035:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265316.255065:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540353c000 x1876180553712896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265316.255082:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553712896:0@lo:13: 00010000:00010000:2.0:1789265316.385620:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265317.406803:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265318.432623:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265319.455188:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265319.846732:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553713024:0@lo:400: 00000100:00100000:1.0:1789265319.846837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265319.846891:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553713536:0@lo:400: 00000100:00100000:1.0:1789265319.846936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265319.850170:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553713408:0@lo:400: 00000100:00100000:0.0:1789265319.850248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265319.850323:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553713408 00000100:00100000:0.0:1789265319.850354:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553713408 00000100:00100000:0.0:1789265319.850418:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265319.850427:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553713408:12345-0@lo:400: 00000100:00100000:0.0:1789265319.850488:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553713408:12345-0@lo:400: Request processed in 61us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265319.850496:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789265319.850521:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265319.850560:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9e300 x1876180553713408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265319.850576:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553713408:0@lo:400: 00000100:00100000:3.0:1789265319.859600:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876180553713280:0@lo:400: 00000100:00100000:0.0:1789265319.861465:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553713024 00000100:00100000:0.0:1789265319.861484:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553713024 00000100:00100000:1.0:1789265319.861998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265319.862023:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265319.862037:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553713152:0@lo:400: 00000100:00100000:1.0:1789265319.862104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265319.862135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553713536 00000100:00100000:1.0:1789265319.862139:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553713536 00000100:00100000:1.0:1789265319.862187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553713280 00000100:00100000:1.0:1789265319.862191:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553713280 00000100:00100000:1.0:1789265319.862210:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553713152 00000100:00100000:1.0:1789265319.862212:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553713152 00000100:00100000:1.0:1789265319.862227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265319.862237:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553713536:12345-0@lo:400: 00000100:00100000:1.0:1789265319.862309:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553713536:12345-0@lo:400: Request processed in 73us (15371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265319.862317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265319.862359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265319.862368:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876180553713280:12345-0@lo:400: 00000100:00100000:1.0:1789265319.862401:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876180553713280:12345-0@lo:400: Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265319.862407:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265319.862417:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265319.862423:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553713152:12345-0@lo:400: 00000100:00100000:1.0:1789265319.862448:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553713152:12345-0@lo:400: Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265319.862468:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789265319.862488:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265319.862541:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9fb80 x1876180553713152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265319.862555:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553713152:0@lo:400: 00010000:00080000:1.0:1789265319.862567:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9ed80 x1876180553713280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265319.862575:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876180553713280:0@lo:400: 00010000:00080000:1.0:1789265319.862604:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9c380 x1876180553713536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265319.862612:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553713536:0@lo:400: 00000100:00100000:0.0:1789265319.866316:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265319.866348:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3307:x1876180553713024:12345-0@lo:400: 00000100:00100000:0.0:1789265319.866473:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3307:x1876180553713024:12345-0@lo:400: Request processed in 144us (19637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265319.866481:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265319.866679:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553713024:0@lo:400: 00010000:00010000:0.0:1789265320.478505:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265321.383997:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265321.384059:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553713664:0@lo:13: 00000100:00100000:1.0:1789265321.384176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265321.391612:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553713664 00000100:00100000:0.0:1789265321.391627:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553713664 00000100:00100000:0.0:1789265321.391704:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265321.391718:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553713664:12345-0@lo:13: 00002000:00000024:0.0:1789265321.391764:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265321.391862:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553713664:12345-0@lo:13: Request processed in 148us (7687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.391869:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789265321.391889:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265321.391924:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9c380 x1876180553713664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265321.391945:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553713664:0@lo:13: 00010000:00010000:0.0:1789265321.502844:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265322.147281:0:7969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265322.527445:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265323.554800:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789265323.938322:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789265323.938330:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92543b68a800 from 30 10000000:01000000:3.0:1789265323.938367:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265323.938409:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.938421:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.938432:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.938453:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553713792:0@lo:101: 00000100:00100000:3.0:1789265323.938519:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.938567:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.938661:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553713792 00000100:00100000:3.0:1789265323.938669:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553713792 00000100:00100000:3.0:1789265323.938718:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265323.938726:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553713792:12345-0@lo:101: 00010000:00010000:3.0:1789265323.938740:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265323.938751:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f36b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.938775:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f36b expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.938785:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f36b expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.938801:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9254027df600, rc 0) 00000100:00100000:3.0:1789265323.938836:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553713792:12345-0@lo:101: Request processed in 111us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.938843:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265323.938891:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553713792:0@lo:101: 00010000:00010000:3.0:1789265323.938904:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.938913:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.938965:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553713920:0@lo:501: 00000100:00100000:3.0:1789265323.938991:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.939023:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.939035:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553713920 00000100:00100000:3.0:1789265323.939038:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553713920 00000100:00100000:3.0:1789265323.939059:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265323.939065:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553713920:12345-0@lo:501: 00000100:00100000:3.0:1789265323.944103:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553713920:12345-0@lo:501: Request processed in 5030us (5103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.944132:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265323.944231:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553713920:0@lo:501: 00000100:00100000:3.0:1789265323.944285:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553714048:0@lo:503: 00000100:00100000:3.0:1789265323.944355:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.944383:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.944407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553714048 00000100:00100000:3.0:1789265323.944414:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553714048 00000100:00100000:3.0:1789265323.944449:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265323.944458:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553714048:12345-0@lo:503: 00000100:00100000:3.0:1789265323.944775:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553714048:12345-0@lo:503: Request processed in 317us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.944782:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789265323.945266:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553714048:0@lo:503: 00000100:00100000:0.0:1789265323.947468:0:8037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8037:1876180553714176:0@lo:502: 00000100:00100000:0.0:1789265323.947563:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265323.947603:0:8037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9253050e9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.950757:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553714176 00000100:00100000:3.0:1789265323.950774:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553714176 00000100:00100000:3.0:1789265323.951046:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265323.951057:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8037:x1876180553714176:12345-0@lo:502: 00000100:00100000:3.0:1789265323.951764:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8037:x1876180553714176:12345-0@lo:502: Request processed in 706us (4198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.951771:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789265323.952100:0:8037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8037:1876180553714176:0@lo:502: 00000100:00100000:0.0:1789265323.952198:0:8037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8037:1876180553714304:0@lo:502: 00000100:00100000:0.0:1789265323.952244:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265323.952286:0:8037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9253050e9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.952631:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553714304 00000100:00100000:3.0:1789265323.952637:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553714304 00000100:00100000:3.0:1789265323.952673:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265323.952679:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8037:x1876180553714304:12345-0@lo:502: 00000100:00100000:3.0:1789265323.952854:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8037:x1876180553714304:12345-0@lo:502: Request processed in 173us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.952861:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265323.952904:0:8037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8037:1876180553714304:0@lo:502: 00000040:00080000:3.0:1789265323.952925:0:8037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789265323.953013:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789265323.953033:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265323.953044:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.953066:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265323.953076:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789265323.953078:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789265323.953081:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789265323.953105:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.953113:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.953122:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.953134:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553714432:0@lo:101: 00000100:00100000:3.0:1789265323.953271:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.953293:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.953306:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553714432 00000100:00100000:3.0:1789265323.953310:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553714432 00000100:00100000:3.0:1789265323.953351:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265323.953357:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553714432:12345-0@lo:101: 00010000:00010000:3.0:1789265323.953366:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265323.953378:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f379 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.953400:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f379 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.953420:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f379 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.953428:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9254027df800, rc 0) 00000100:00100000:3.0:1789265323.953455:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553714432:12345-0@lo:101: Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.953460:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265323.953487:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553714432:0@lo:101: 00010000:00010000:3.0:1789265323.953498:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.953506:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.953544:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553714560:0@lo:501: 00000100:00100000:3.0:1789265323.953566:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.953578:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.953589:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553714560 00000100:00100000:3.0:1789265323.953592:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553714560 00000100:00100000:3.0:1789265323.953610:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265323.953615:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553714560:12345-0@lo:501: 00000100:00100000:3.0:1789265323.953831:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553714560:12345-0@lo:501: Request processed in 214us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.953837:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265323.953863:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553714560:0@lo:501: 00000100:00100000:3.0:1789265323.953882:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553714688:0@lo:503: 00000100:00100000:3.0:1789265323.953919:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.953930:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.954284:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553714688 00000100:00100000:3.0:1789265323.954289:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553714688 00000100:00100000:3.0:1789265323.954312:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265323.954318:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553714688:12345-0@lo:503: 00000100:00100000:3.0:1789265323.954604:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553714688:12345-0@lo:503: Request processed in 285us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.954611:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265323.954650:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553714688:0@lo:503: 00000100:00100000:0.0:1789265323.955491:0:8039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8039:1876180553714816:0@lo:502: 00000100:00100000:0.0:1789265323.955543:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265323.955573:0:8039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9253050e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.956404:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553714816 00000100:00100000:3.0:1789265323.956412:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553714816 00000100:00100000:3.0:1789265323.956452:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265323.956460:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:8039:x1876180553714816:12345-0@lo:502: 00000100:00100000:3.0:1789265323.956701:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:8039:x1876180553714816:12345-0@lo:502: Request processed in 241us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.956709:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789265323.957077:0:8039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8039:1876180553714816:0@lo:502: 00000020:01000000:1.0:1789265323.957110:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265323.957130:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265323.957133:0:8039:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265323.957139:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265323.957141:0:8039:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789265323.957499:0:8039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8039:1876180553714944:0@lo:502: 00000100:00100000:1.0:1789265323.957550:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265323.957587:0:8039:0:(client.c:2715:ptlrpc_set_wait()) set ffff92542fc379c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265323.957599:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553714944 00000100:00100000:0.0:1789265323.957604:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553714944 00000100:00100000:0.0:1789265323.957645:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789265323.957653:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:8039:x1876180553714944:12345-0@lo:502: 00000100:00100000:0.0:1789265323.957818:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:8039:x1876180553714944:12345-0@lo:502: Request processed in 165us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.957825:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265323.958064:0:8039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8039:1876180553714944:0@lo:502: 00000020:01000000:1.0:1789265323.958094:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265323.958098:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265323.958100:0:8039:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789265323.958103:0:8039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789265323.958262:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789265323.958281:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789265323.958292:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.958489:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265323.958502:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789265323.958504:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff925409ebd800 from 30 10000000:01000000:3.0:1789265323.958507:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265323.958544:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.958553:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.958562:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.958576:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715072:0@lo:101: 00000100:00100000:3.0:1789265323.958613:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.958786:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265323.962894:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553715072 00000100:00100000:1.0:1789265323.962910:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553715072 00000100:00100000:1.0:1789265323.962974:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265323.962983:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553715072:12345-0@lo:101: 00010000:00010000:1.0:1789265323.963010:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265323.963026:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f387 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.963053:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f387 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.963063:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f387 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.963072:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207d400, rc 0) 00000100:00100000:1.0:1789265323.963140:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553715072:12345-0@lo:101: Request processed in 158us (4526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265323.963147:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265323.963213:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715072:0@lo:101: 00010000:00010000:1.0:1789265323.963230:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.963240:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265323.963322:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715200:0@lo:501: 00000100:00100000:1.0:1789265323.963373:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265323.963402:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92542fc37240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265323.963430:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553715200 00000100:00100000:1.0:1789265323.963433:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553715200 00000100:00100000:1.0:1789265323.963454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265323.963460:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553715200:12345-0@lo:501: 00000100:00100000:1.0:1789265323.967114:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553715200:12345-0@lo:501: Request processed in 3643us (3729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265323.967128:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265323.967228:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715200:0@lo:501: 00000100:00100000:1.0:1789265323.967283:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715328:0@lo:503: 00000100:00100000:1.0:1789265323.967365:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265323.967396:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92542fc37240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265323.967411:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553715328 00000100:00100000:1.0:1789265323.967417:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553715328 00000100:00100000:1.0:1789265323.967451:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265323.967458:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553715328:12345-0@lo:503: 00000100:00100000:1.0:1789265323.967651:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553715328:12345-0@lo:503: Request processed in 192us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265323.967659:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265323.967724:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715328:0@lo:503: 00000100:00100000:0.0:1789265323.980429:0:8040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8040:1876180553715456:0@lo:502: 00000100:00100000:0.0:1789265323.980536:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265323.980603:0:8040:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306b5c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265323.984161:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553715456 00000100:00100000:1.0:1789265323.984177:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553715456 00000100:00100000:1.0:1789265323.984251:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265323.984261:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:8040:x1876180553715456:12345-0@lo:502: 00000100:00100000:1.0:1789265323.984606:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:8040:x1876180553715456:12345-0@lo:502: Request processed in 346us (4069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265323.984615:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789265323.991834:0:8040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8040:1876180553715456:0@lo:502: 00000100:00100000:0.0:1789265323.991917:0:8040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8040:1876180553715584:0@lo:502: 00000100:00100000:0.0:1789265323.993171:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265323.993239:0:8040:0:(client.c:2715:ptlrpc_set_wait()) set ffff925306b5c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265323.993370:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553715584 00000100:00100000:3.0:1789265323.993379:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553715584 00000100:00100000:3.0:1789265323.993435:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789265323.993445:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:8040:x1876180553715584:12345-0@lo:502: 00000100:00100000:3.0:1789265323.993710:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:8040:x1876180553715584:12345-0@lo:502: Request processed in 266us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.993718:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789265323.995424:0:8040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8040:1876180553715584:0@lo:502: 00000040:00080000:0.0:1789265323.995468:0:8040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789265323.996204:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789265323.996236:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265323.996247:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.996259:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265323.996270:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789265323.996272:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff925409ebd800 from 5 10000000:01000000:3.0:1789265323.996275:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265323.996321:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.996356:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.996367:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.996387:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715712:0@lo:101: 00000100:00100000:3.0:1789265323.996449:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.996481:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265323.996553:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553715712 00000100:00100000:0.0:1789265323.996571:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553715712 00000100:00100000:0.0:1789265323.996621:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789265323.996631:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553715712:12345-0@lo:101: 00010000:00010000:0.0:1789265323.996644:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265323.996658:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925400030600/0x8e12577ef818f39c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f395 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.996679:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400030600/0x8e12577ef818f39c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f395 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.996690:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925400030600/0x8e12577ef818f39c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f395 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.996699:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925400030600, rc 0) 00000100:00100000:0.0:1789265323.996739:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553715712:12345-0@lo:101: Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.996746:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789265323.996820:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715712:0@lo:101: 00010000:00010000:3.0:1789265323.996833:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.996841:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.996885:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715840:0@lo:256: 00000100:00100000:3.0:1789265323.996917:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.996949:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265323.997054:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553715840 00000100:00100000:0.0:1789265323.997059:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553715840 00000100:00100000:0.0:1789265323.997083:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265323.997089:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553715840:12345-0@lo:256: 20000000:01000000:0.0:1789265323.997103:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265323.997120:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265323.997123:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789265323.997211:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553715840:12345-0@lo:256: Request processed in 121us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.997218:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789265323.997283:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715840:0@lo:256: 10000000:01000000:3.0:1789265323.997324:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265323.997358:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.997367:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265323.997380:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789265323.997382:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789265323.997384:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789265323.997399:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.997405:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.997413:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.997423:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715968:0@lo:101: 00000100:00100000:3.0:1789265323.997449:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.997468:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265323.997521:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553715968 00000100:00100000:0.0:1789265323.997529:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553715968 00000100:00100000:0.0:1789265323.997551:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265323.997557:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553715968:12345-0@lo:101: 00010000:00010000:0.0:1789265323.997564:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265323.997573:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f3a3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.997587:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.997594:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.997600:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925400030e00, rc 0) 00000100:00100000:0.0:1789265323.997640:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553715968:12345-0@lo:101: Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.997645:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789265323.997707:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553715968:0@lo:101: 00010000:00010000:3.0:1789265323.997716:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.997723:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265323.997764:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553716096:0@lo:501: 00000100:00100000:3.0:1789265323.997788:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.997808:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265323.997890:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553716096 00000100:00100000:0.0:1789265323.997894:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553716096 00000100:00100000:0.0:1789265323.997933:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265323.997939:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553716096:12345-0@lo:501: 00000100:00100000:0.0:1789265323.998195:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553716096:12345-0@lo:501: Request processed in 256us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.998202:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789265323.998452:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553716096:0@lo:501: 00000100:00100000:3.0:1789265323.998482:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553716224:0@lo:503: 00000100:00100000:3.0:1789265323.998526:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.998542:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265323.998629:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553716224 00000100:00100000:0.0:1789265323.998634:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553716224 00000100:00100000:0.0:1789265323.998657:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789265323.998663:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553716224:12345-0@lo:503: 00000100:00100000:0.0:1789265323.999029:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553716224:12345-0@lo:503: Request processed in 365us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.999044:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265323.999120:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553716224:0@lo:503: 00000100:00100000:3.0:1789265323.999840:0:8042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8042:1876180553716352:0@lo:502: 00000100:00100000:3.0:1789265323.999889:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265323.999914:0:8042:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265324.001623:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553716352 00000100:00100000:0.0:1789265324.001636:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553716352 00000100:00100000:0.0:1789265324.001692:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789265324.001702:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8042:x1876180553716352:12345-0@lo:502: 00000100:00100000:0.0:1789265324.002085:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8042:x1876180553716352:12345-0@lo:502: Request processed in 383us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265324.002093:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265324.002756:0:8042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8042:1876180553716352:0@lo:502: 00000020:01000000:2.0:1789265324.002793:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265324.002802:0:8042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789265324.002810:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265324.002812:0:8042:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789265324.002819:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789265324.002823:0:8042:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.143@tcp to nid 0x20000c0a8cc8f (192.168.204.143@tcp) 00000020:01000000:2.0:1789265324.002856:0:8042:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789265324.002859:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265324.002874:0:8042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff925403ed19b8) 00000020:00000080:2.0:1789265324.002895:0:8042:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789265324.002901:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789265324.004106:0:8042:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789265324.004116:0:8042:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789265324.004138:0:8042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef818f3b8 00010000:00080000:2.0:1789265324.004190:0:8042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff925441447800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:2.0:1789265324.004446:0:8042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789265324.004866:0:8042:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789265324.004880:0:8042:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789265324.005453:0:8042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265324.005661:0:8042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265324.005719:0:8042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789265324.005786:0:8042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789265324.007126:0:8043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265324.007133:0:8043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789265324.009875:0:8042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265324.009895:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789265324.009944:0:8042:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789265324.009972:0:8042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef818f3bf 00000100:00080000:1.0:1789265324.009982:0:8042:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265324.009988:0:8042:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff925441447800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1789265324.010043:0:8042:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9fb80 x1876180553716480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265324.010071:0:8042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789265324.010182:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553716608:0@lo:400: 00000100:00100000:1.0:1789265324.010263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265324.010302:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265324.010307:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553716992:0@lo:400: 00000100:00100000:1.0:1789265324.010360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265324.010393:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553716736:0@lo:400: 00000100:00100000:1.0:1789265324.010418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265324.010437:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265324.010442:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553716864:0@lo:400: 00000100:00100000:1.0:1789265324.010491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265324.010536:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553716608 00000100:00100000:1.0:1789265324.010543:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553716608 00000100:00100000:1.0:1789265324.010582:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553716992 00000100:00100000:1.0:1789265324.010591:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553716992 00000100:00100000:1.0:1789265324.010616:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553716736 00000100:00100000:1.0:1789265324.010619:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553716736 00000100:00100000:1.0:1789265324.010633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265324.010641:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553716608:12345-0@lo:400: 00000100:00100000:1.0:1789265324.010696:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553716608:12345-0@lo:400: Request processed in 54us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265324.010703:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265324.010719:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265324.010726:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553716992:12345-0@lo:400: 00000100:00100000:1.0:1789265324.010753:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553716992:12345-0@lo:400: Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265324.010758:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265324.010769:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265324.010775:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553716736:12345-0@lo:400: 00000100:00100000:1.0:1789265324.010805:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553716736:12345-0@lo:400: Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265324.010810:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265324.010835:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553716864 00000100:00100000:1.0:1789265324.010839:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553716864 00000100:00100000:1.0:1789265324.010868:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265324.010875:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553716864:12345-0@lo:400: 00000100:00100000:1.0:1789265324.010905:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553716864:12345-0@lo:400: Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265324.010910:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789265324.010925:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265324.010929:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265324.010958:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9f100 x1876180553716864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265324.010978:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553716864:0@lo:400: 00010000:00080000:1.0:1789265324.010991:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9dc00 x1876180553716736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265324.011014:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553716736:0@lo:400: 00010000:00080000:1.0:1789265324.011048:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9d180 x1876180553716992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265324.011056:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553716992:0@lo:400: 00010000:00080000:1.0:1789265324.011065:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9d500 x1876180553716608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265324.011072:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553716608:0@lo:400: 00000020:01000000:1.0:1789265324.011132:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265324.011138:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265324.011140:0:8042:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789265324.011143:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265324.011146:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265324.011148:0:8042:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265324.011150:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265324.011152:0:8042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789265324.011179:0:8042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8042:1876180553717120:0@lo:502: 00000100:00100000:1.0:1789265324.011225:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265324.011260:0:8042:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b3cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265324.011366:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553716480:0@lo:8: 00000100:00100000:3.0:1789265324.011402:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265324.011415:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553717120 00000100:00100000:2.0:1789265324.011421:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553717120 00000100:00100000:2.0:1789265324.011452:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789265324.011460:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8042:x1876180553717120:12345-0@lo:502: 00000100:00100000:2.0:1789265324.011721:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8042:x1876180553717120:12345-0@lo:502: Request processed in 261us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265324.011729:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789265324.011754:0:8042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8042:1876180553717120:0@lo:502: 00000020:01000000:3.0:1789265324.011776:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265324.011781:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265324.011783:0:8042:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789265324.011793:0:8042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789265324.011914:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789265324.011933:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789265324.011942:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265324.011954:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265324.011963:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789265324.011966:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925402d54d28 from 1 10000000:01000000:2.0:1789265324.011969:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789265324.011992:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265324.012011:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553716480 00010000:00010000:2.0:1789265324.012014:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265324.012015:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553716480 00010000:00010000:2.0:1789265324.012023:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265324.012048:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553717248:0@lo:101: 00000100:00100000:2.0:1789265324.012076:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265324.012078:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265324.012083:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876180553716480:12345-0@lo:8: 00000100:00100000:2.0:1789265324.012091:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92530698bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265324.012103:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553717248 00000100:00100000:2.0:1789265324.012106:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553717248 00010000:00080000:1.0:1789265324.012113:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000100:00100000:2.0:1789265324.012144:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000020:00000080:1.0:1789265324.012147:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef818f3cd 00000100:00100000:2.0:1789265324.012150:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553717248:12345-0@lo:101: 00010000:00010000:2.0:1789265324.012158:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1789265324.012161:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92543b669000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789265324.012165:0:6678:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789265324.012169:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789265324.012173:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f3c6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265324.012196:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265324.012206:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265324.012215:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136400, rc 0) 00000100:00100000:2.0:1789265324.012240:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553717248:12345-0@lo:101: Request processed in 91us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265324.012246:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789265324.012282:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553717248:0@lo:101: 00010000:00010000:2.0:1789265324.012293:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1789265324.012301:0:6678:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:2.0:1789265324.012302:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265324.012373:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553717376:0@lo:501: 00000100:00100000:2.0:1789265324.012396:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265324.012413:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92530698bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265324.012424:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553717376 00000100:00100000:2.0:1789265324.012427:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553717376 00000100:00100000:2.0:1789265324.012446:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789265324.012452:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553717376:12345-0@lo:501: 00002000:00080000:1.0:1789265324.012487:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789265324.012509:0:6678:0:(import.c:65:import_set_state_nolock()) ffff92543b66a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265324.012548:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876180553716480:12345-0@lo:8: Request processed in 464us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265324.012555:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265324.012652:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553717376:12345-0@lo:501: Request processed in 199us (254us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265324.012659:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789265324.012687:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553717376:0@lo:501: 10000000:01000000:2.0:1789265324.012707:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789265324.012713:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265324.012720:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789265324.018654:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9fb80 x1876180553716480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265324.018670:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265324.018681:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789265324.018690:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789265324.018697:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789265324.018717:0:3303:0:(import.c:65:import_set_state_nolock()) ffff925441447800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789265324.018734:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789265324.018741:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553716480:0@lo:8: 00000004:00080000:3.0:1789265324.018804:0:8043:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265324.018948:0:8043:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 179252615272ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789265324.087786:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789265324.145706:0:8044:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789265324.145739:0:8044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876180553717632:0@lo:7: 00000100:00100000:2.0:1789265324.145825:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265324.145872:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553717632 00000100:00100000:2.0:1789265324.145878:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553717632 00000100:00100000:2.0:1789265324.145939:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265324.145950:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8044:x1876180553717632:12345-0@lo:7: 00000100:00100000:0.0:1789265324.148605:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265324.148632:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553717504:0@lo:13: 00000100:00100000:0.0:1789265324.148702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265324.148794:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553717504 00000100:00100000:0.0:1789265324.148801:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553717504 00000100:00100000:0.0:1789265324.148843:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265324.148851:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553717504:12345-0@lo:13: 00002000:00000024:0.0:1789265324.148877:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789265324.148922:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553717504:12345-0@lo:13: Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265324.148929:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789265324.148970:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543b9df100 x1876180553717504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265324.148989:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553717504:0@lo:13: 00000100:00080000:0.0:1789265324.152688:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265324.152723:0:8044:0:(client.c:2715:ptlrpc_set_wait()) set ffff92530698b840 going to sleep for 11 seconds 00002000:00080000:2.0:1789265324.169051:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789265324.169062:0:6680:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789265324.169176:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8044:x1876180553717632:12345-0@lo:7: Request processed in 23225us (23347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265324.169187:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789265324.169452:0:8044:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543b9dd880 x1876180553717632/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265340 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265324.169490:0:8044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876180553717632:0@lo:7: 00000004:00080000:0.0:1789265324.169505:0:8044:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789265324.169545:0:8044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876180553717760:0@lo:5: 00000100:00100000:0.0:1789265324.169582:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265324.169641:0:8044:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a5c6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265324.169719:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553717760 00000100:00100000:1.0:1789265324.169727:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553717760 00000100:00100000:1.0:1789265324.169782:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265324.169791:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8044:x1876180553717760:12345-0@lo:5: 00002000:00080000:1.0:1789265324.169817:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789265324.169821:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789265324.170163:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8044:x1876180553717760:12345-0@lo:5: Request processed in 372us (580us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789265324.170171:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789265324.172072:0:8044:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540353df80 x1876180553717760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265340 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265324.172091:0:8044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876180553717760:0@lo:5: 00000004:00080000:2.0:1789265324.172104:0:8044:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789265324.172142:0:8044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876180553717888:0@lo:700: 00000100:00100000:2.0:1789265324.172263:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265324.172299:0:8044:0:(client.c:2715:ptlrpc_set_wait()) set ffff92530698bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265324.172369:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553717888 00000100:00100000:1.0:1789265324.172375:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553717888 00000100:00100000:1.0:1789265324.172419:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265324.172426:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8044:x1876180553717888:12345-0@lo:700: 00000100:00100000:1.0:1789265324.172461:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6687:1876180553718016:0@lo:700: 00000100:00100000:1.0:1789265324.172491:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265324.172529:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b3cd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265324.173024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553718016 00000100:00100000:2.0:1789265324.173029:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553718016 00000100:00100000:2.0:1789265324.173068:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265324.173075:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6687:x1876180553718016:12345-0@lo:700: 40000000:02000000:0.0:1789265324.252949:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789265324.268731:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6687:x1876180553718016:12345-0@lo:700: Request processed in 95641us (96223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265324.268755:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265324.274053:0:6687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441888a80 x1876180553718016/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265340 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265324.274072:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6687:1876180553718016:0@lo:700: 40000000:02000000:2.0:1789265324.274086:0:6687:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1789265324.432430:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789265324.432448:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789265324.437423:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8044:x1876180553717888:12345-0@lo:700: Request processed in 264990us (265153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265324.437449:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265324.438274:0:8044:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543b9dd880 x1876180553717888/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265340 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265324.438287:0:8044:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789265324.438306:0:8044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876180553717888:0@lo:700: 00000004:02000040:3.0:1789265324.497450:0:8044:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789265324.504648:0:8044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876180553718144:0@lo:5: 00000100:00100000:3.0:1789265324.504717:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265324.505126:0:8044:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403280300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265324.505312:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553718144 00000100:00100000:0.0:1789265324.505320:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553718144 00000100:00100000:0.0:1789265324.507089:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265324.507101:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8044:x1876180553718144:12345-0@lo:5: 00002000:00080000:1.0:1789265324.524266:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789265324.524288:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789265324.530028:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8044:x1876180553718144:12345-0@lo:5: Request processed in 22919us (25300us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789265324.530041:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789265324.530128:0:8044:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543be41f80 x1876180553718144/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265340 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265324.530146:0:8044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876180553718144:0@lo:5: 00000004:00080000:2.0:1789265324.530163:0:8044:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789265324.574547:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265325.598820:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265326.499321:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553718272:0@lo:13: 00000100:00100000:1.0:1789265326.499421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265326.499512:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553718272 00000100:00100000:1.0:1789265326.499520:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553718272 00000100:00100000:1.0:1789265326.499576:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265326.499584:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553718272:12345-0@lo:13: 00002000:00000024:1.0:1789265326.499624:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265326.499671:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553718272:12345-0@lo:13: Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265326.499678:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789265326.499701:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265326.499731:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543b9dc000 x1876180553718272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265326.499750:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553718272:0@lo:13: 00010000:00010000:3.0:1789265326.622618:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265327.648726:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265328.671600:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789265328.808008:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1789265329.054590:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544188b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553718784:0@lo:400: 00000100:00100000:1.0:1789265329.054699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265329.054774:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265329.054781:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544188a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553718400:0@lo:400: 00000100:00100000:1.0:1789265329.054815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265329.054841:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544188aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553718912:0@lo:400: 00000100:00100000:1.0:1789265329.054870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265329.054934:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553718528:0@lo:400: 00000100:00100000:1.0:1789265329.054963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265329.054984:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553719040:0@lo:400: 00000100:00100000:1.0:1789265329.055009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265329.055028:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265329.055033:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553718656:0@lo:400: 00000100:00100000:1.0:1789265329.055055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265329.055090:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553718784 00000100:00100000:1.0:1789265329.055099:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553718784 00000100:00100000:1.0:1789265329.055166:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553719040 00000100:00100000:1.0:1789265329.055170:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553719040 00000100:00100000:1.0:1789265329.055192:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265329.055202:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553718784:12345-0@lo:400: 00000100:00100000:1.0:1789265329.055261:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553718784:12345-0@lo:400: Request processed in 61us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.055270:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265329.055289:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265329.055296:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553719040:12345-0@lo:400: 00000100:00100000:1.0:1789265329.055328:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553719040:12345-0@lo:400: Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.055369:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265329.055392:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553718400 00000100:00100000:1.0:1789265329.055397:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553718400 00000100:00100000:1.0:1789265329.055429:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789265329.055436:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553718400:12345-0@lo:400: 00000100:00100000:1.0:1789265329.055470:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553718400:12345-0@lo:400: Request processed in 34us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.055486:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789265329.055517:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553718912 00000100:00100000:1.0:1789265329.055521:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553718912 00000100:00100000:1.0:1789265329.055544:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553718528 00000100:00100000:1.0:1789265329.055546:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553718528 00000100:00100000:1.0:1789265329.055557:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553718656 00000100:00100000:1.0:1789265329.055559:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553718656 00000100:00100000:1.0:1789265329.055572:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265329.055578:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553718912:12345-0@lo:400: 00000100:00100000:1.0:1789265329.055608:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553718912:12345-0@lo:400: Request processed in 30us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.055614:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265329.055625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265329.055631:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553718528:12345-0@lo:400: 00000100:00100000:1.0:1789265329.055657:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553718528:12345-0@lo:400: Request processed in 26us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.055662:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265329.055672:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265329.055678:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553718656:12345-0@lo:400: 00000100:00100000:1.0:1789265329.055704:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553718656:12345-0@lo:400: Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.055709:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789265329.055737:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265329.055742:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265329.055744:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265329.055780:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544188a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553718400:0@lo:400: 00010000:00080000:1.0:1789265329.055797:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544188aa00 x1876180553718912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265329.055818:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544188aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553718912:0@lo:400: 00010000:00080000:1.0:1789265329.055831:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544188b100 x1876180553718784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265329.055839:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544188b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553718784:0@lo:400: 00010000:00080000:1.0:1789265329.055874:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441889180 x1876180553718656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265329.055883:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553718656:0@lo:400: 00010000:00080000:1.0:1789265329.055893:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441888000 x1876180553718528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265329.055912:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553718528:0@lo:400: 00010000:00080000:1.0:1789265329.055925:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441888700 x1876180553719040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265329.055932:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789265329.055942:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553719040:0@lo:400: 00000100:00100000:0.0:1789265329.396196:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265329.396276:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533772416 00000100:00100000:1.0:1789265329.396286:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533772416 00000100:00100000:1.0:1789265329.396369:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 112 00000100:00100000:1.0:1789265329.396378:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2341:x1876180533772416:12345-192.168.204.43@tcp:250: 00010000:00080000:1.0:1789265329.396407:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f248648a-8946-448c-8146-af0e3c141002@192.168.204.43@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1789265329.396679:0:5826:0:(genops.c:1385:class_connect()) connect: client f248648a-8946-448c-8146-af0e3c141002, cookie 0x8e12577ef818f3db 00000100:00080000:0.0:1789265329.396839:0:5826:0:(import.c:65:import_set_state_nolock()) ffff925441866800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265329.396920:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+5:2341:x1876180533772416:12345-192.168.204.43@tcp:250: Request processed in 541us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265329.396928:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 112 00000100:00100000:3.0:1789265329.413150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265329.413608:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533772544 00000100:00100000:1.0:1789265329.413618:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533772544 00000100:00100000:1.0:1789265329.413668:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:1.0:1789265329.413678:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+5:5574:x1876180533772544:12345-192.168.204.43@tcp:101: 00010000:00010000:1.0:1789265329.413719:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265329.413738:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f82c9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265329.413767:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265329.413965:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265329.413977:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207d600, rc 0) 00000100:00100000:1.0:1789265329.414040:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+6:5574:x1876180533772544:12345-192.168.204.43@tcp:101: Request processed in 363us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.414047:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:3.0:1789265329.420388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265329.420545:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533772672 00000100:00100000:0.0:1789265329.420555:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533772672 00000100:00100000:0.0:1789265329.420611:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:0.0:1789265329.420635:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+6:5574:x1876180533772672:12345-192.168.204.43@tcp:501: 00000100:00100000:0.0:1789265329.421229:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+6:5574:x1876180533772672:12345-192.168.204.43@tcp:501: Request processed in 592us (847us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265329.421238:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:3.0:1789265329.429682:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265329.430016:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533772800 00000100:00100000:2.0:1789265329.430028:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533772800 00000100:00100000:2.0:1789265329.430085:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:2.0:1789265329.430095:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+6:5574:x1876180533772800:12345-192.168.204.43@tcp:101: 00010000:00010000:2.0:1789265329.430110:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265329.430127:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f82d0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.430155:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.430167:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.430177:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137c00, rc 0) 00000100:00100000:2.0:1789265329.430235:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+7:5574:x1876180533772800:12345-192.168.204.43@tcp:101: Request processed in 142us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265329.430242:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:0.0:1789265329.436626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265329.437269:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533772928 00000100:00100000:3.0:1789265329.437280:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533772928 00000100:00100000:3.0:1789265329.437372:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:3.0:1789265329.437384:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+7:5574:x1876180533772928:12345-192.168.204.43@tcp:501: 00000100:00100000:3.0:1789265329.437647:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+8:5574:x1876180533772928:12345-192.168.204.43@tcp:501: Request processed in 264us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265329.437660:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:0.0:1789265329.444776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265329.444932:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533773056 00000100:00100000:3.0:1789265329.444943:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533773056 00000100:00100000:3.0:1789265329.445002:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:3.0:1789265329.445012:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+8:5574:x1876180533773056:12345-192.168.204.43@tcp:503: 00000100:00100000:3.0:1789265329.445395:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+8:5574:x1876180533773056:12345-192.168.204.43@tcp:503: Request processed in 383us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265329.445404:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:3.0:1789265329.452161:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265329.452262:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533773184 00000100:00100000:0.0:1789265329.452272:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533773184 00000100:00100000:0.0:1789265329.452347:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:0.0:1789265329.452358:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+8:5592:x1876180533773184:12345-192.168.204.43@tcp:502: 00000100:00100000:0.0:1789265329.453231:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+8:5592:x1876180533773184:12345-192.168.204.43@tcp:502: Request processed in 868us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265329.453242:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:1.0:1789265329.500515:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265329.500655:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533773312 00000100:00100000:0.0:1789265329.500665:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533773312 00000100:00100000:0.0:1789265329.500728:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:0.0:1789265329.500738:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+8:5592:x1876180533773312:12345-192.168.204.43@tcp:502: 00000100:00100000:0.0:1789265329.501042:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+8:5592:x1876180533773312:12345-192.168.204.43@tcp:502: Request processed in 305us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265329.501050:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:0.0:1789265329.517637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265329.517736:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533773440 00000100:00100000:2.0:1789265329.517747:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533773440 00000100:00100000:2.0:1789265329.517811:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:2.0:1789265329.517822:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+8:5574:x1876180533773440:12345-192.168.204.43@tcp:101: 00010000:00010000:2.0:1789265329.517838:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265329.517856:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136600/0x8e12577ef818f3f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f82fa expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.517884:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136600/0x8e12577ef818f3f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82fa expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.517921:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136600/0x8e12577ef818f3f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82fa expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.517931:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136600, rc 0) 00000100:00100000:2.0:1789265329.517985:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+9:5574:x1876180533773440:12345-192.168.204.43@tcp:101: Request processed in 166us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265329.517992:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:2.0:1789265329.528248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265329.528405:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533773568 00000100:00100000:3.0:1789265329.528425:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533773568 00000100:00100000:3.0:1789265329.528515:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:3.0:1789265329.528529:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+9:5574:x1876180533773568:12345-192.168.204.43@tcp:256: 20000000:01000000:3.0:1789265329.528564:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789265329.528600:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789265329.528605:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789265329.528608:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789265329.528611:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789265329.542909:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+9:5574:x1876180533773568:12345-192.168.204.43@tcp:256: Request processed in 14363us (14651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.542923:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:2.0:1789265329.588568:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265329.588593:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553719168:0@lo:13: 00000100:00100000:2.0:1789265329.588663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265329.590734:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553719168 00000100:00100000:2.0:1789265329.590747:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553719168 00000100:00100000:2.0:1789265329.590806:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265329.590817:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553719168:12345-0@lo:13: 00002000:00000024:2.0:1789265329.590851:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265329.590933:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553719168:12345-0@lo:13: Request processed in 119us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265329.590941:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789265329.609251:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543b9dc700 x1876180553719168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265329.609276:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553719168:0@lo:13: 00000100:00100000:2.0:1789265329.609616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265329.609644:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533773696 00000100:00100000:2.0:1789265329.609650:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533773696 00000100:00100000:2.0:1789265329.609688:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:2.0:1789265329.609710:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+9:5574:x1876180533773696:12345-192.168.204.43@tcp:101: 00010000:00010000:2.0:1789265329.609725:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265329.609741:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8301 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.609769:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.609783:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.609793:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137200, rc 0) 00000100:00100000:2.0:1789265329.609844:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:5574:x1876180533773696:12345-192.168.204.43@tcp:101: Request processed in 135us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265329.609852:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:0.0:1789265329.612714:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265329.612794:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533773824 00000100:00100000:1.0:1789265329.612804:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533773824 00000100:00100000:1.0:1789265329.612857:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:1.0:1789265329.612866:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:5574:x1876180533773824:12345-192.168.204.43@tcp:501: 00000100:00100000:1.0:1789265329.613141:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:5574:x1876180533773824:12345-192.168.204.43@tcp:501: Request processed in 275us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.613150:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:2.0:1789265329.620031:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265329.620110:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533773952 00000100:00100000:0.0:1789265329.620119:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533773952 00000100:00100000:0.0:1789265329.620172:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:0.0:1789265329.620182:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:5574:x1876180533773952:12345-192.168.204.43@tcp:503: 00000100:00100000:0.0:1789265329.620588:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:5574:x1876180533773952:12345-192.168.204.43@tcp:503: Request processed in 406us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265329.620597:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:2.0:1789265329.627937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265329.630760:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533774080 00000100:00100000:0.0:1789265329.630785:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533774080 00000100:00100000:0.0:1789265329.630842:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 125 00000100:00100000:0.0:1789265329.630852:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:5598:x1876180533774080:12345-192.168.204.43@tcp:502: 00000100:00100000:0.0:1789265329.631113:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:5598:x1876180533774080:12345-192.168.204.43@tcp:502: Request processed in 262us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265329.631122:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 125 00000100:00100000:0.0:1789265329.636480:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265329.637117:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533774208 00000100:00100000:2.0:1789265329.637127:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533774208 00000100:00100000:2.0:1789265329.637179:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:2.0:1789265329.637189:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:5598:x1876180533774208:12345-192.168.204.43@tcp:502: 00000100:00100000:2.0:1789265329.637550:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:5598:x1876180533774208:12345-192.168.204.43@tcp:502: Request processed in 361us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265329.637559:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:2.0:1789265329.647601:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265329.647753:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533774336 00000100:00100000:1.0:1789265329.647765:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533774336 00000100:00100000:1.0:1789265329.647833:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:1.0:1789265329.647842:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2341:x1876180533774336:12345-192.168.204.43@tcp:38: 00010000:00080000:1.0:1789265329.647871:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:1.0:1789265329.647932:0:5834:0:(genops.c:1385:class_connect()) connect: client b9773a89-f93c-421a-9c50-bfa3d5c6f2fa, cookie 0x8e12577ef818f3fe 00000004:00100000:1.0:1789265329.647964:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789265329.647970:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789265329.695204:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265329.704566:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9254377ec000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265329.704647:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2341:x1876180533774336:12345-192.168.204.43@tcp:38: Request processed in 56803us (57053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.704658:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:0.0:1789265330.717664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265330.717766:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533774592 00000100:00100000:1.0:1789265330.717776:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533774592 00000100:00100000:1.0:1789265330.717861:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:1.0:1789265330.717888:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5574:x1876180533774592:12345-192.168.204.43@tcp:41: 00000004:00000024:1.0:1789265330.717928:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789265330.717988:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5574:x1876180533774592:12345-192.168.204.43@tcp:41: Request processed in 106us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265330.717995:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00080000:2.0:1789265330.718067:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789265330.718845:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265330.719182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265330.719269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533774464 00000100:00100000:1.0:1789265330.719276:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533774464 00000100:00100000:1.0:1789265330.719539:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:1.0:1789265330.719549:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:0:x1876180533774464:12345-192.168.204.43@tcp:41: 00000004:00000024:1.0:1789265330.719572:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789265330.719629:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:0:x1876180533774464:12345-192.168.204.43@tcp:41: Request processed in 82us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265330.719653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1789265330.722921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265330.723427:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533774720 00000100:00100000:0.0:1789265330.723436:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533774720 00000100:00100000:0.0:1789265330.723498:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:0.0:1789265330.723508:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5574:x1876180533774720:12345-192.168.204.43@tcp:40: 00000100:00100000:0.0:1789265330.723598:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5574:x1876180533774720:12345-192.168.204.43@tcp:40: Request processed in 91us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265330.723606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:0.0:1789265330.730471:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265330.730532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265330.730560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265330.730608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265330.730758:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533774848 00000100:00100000:2.0:1789265330.730784:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533774848 00000100:00100000:2.0:1789265330.730828:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533774976 00000100:00100000:2.0:1789265330.730831:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533774976 00000100:00100000:2.0:1789265330.730847:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:2.0:1789265330.730856:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876180533774848:12345-192.168.204.43@tcp:8: 00010000:00080000:2.0:1789265330.730898:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1789265330.730932:0:6678:0:(genops.c:1385:class_connect()) connect: client b9773a89-f93c-421a-9c50-bfa3d5c6f2fa, cookie 0x8e12577ef818f405 00002000:00100000:2.0:1789265330.730954:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b9773a89-f93c-421a-9c50-bfa3d5c6f2fa/ffff925441443000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265330.730977:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265330.731316:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265330.731378:0:6678:0:(import.c:65:import_set_state_nolock()) ffff925441443800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265330.731445:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2341:x1876180533774848:12345-192.168.204.43@tcp:8: Request processed in 588us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265330.731453:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:2.0:1789265330.731484:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:2.0:1789265330.731490:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876180533774976:12345-192.168.204.43@tcp:8: 00010000:00080000:2.0:1789265330.731521:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1789265330.731539:0:6678:0:(genops.c:1385:class_connect()) connect: client b9773a89-f93c-421a-9c50-bfa3d5c6f2fa, cookie 0x8e12577ef818f40c 00002000:00100000:2.0:1789265330.731544:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b9773a89-f93c-421a-9c50-bfa3d5c6f2fa/ffff925441446000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265330.731550:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265330.731752:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265330.731768:0:6678:0:(import.c:65:import_set_state_nolock()) ffff925441444800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265330.731793:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2341:x1876180533774976:12345-192.168.204.43@tcp:8: Request processed in 301us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265330.731799:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:2.0:1789265330.731833:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533775232 00000100:00100000:2.0:1789265330.731836:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533775232 00000100:00100000:2.0:1789265330.731876:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 127 00000100:00100000:2.0:1789265330.731884:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:2345:x1876180533775232:12345-192.168.204.43@tcp:400: 00000100:00100000:2.0:1789265330.731912:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:2345:x1876180533775232:12345-192.168.204.43@tcp:400: Request processed in 30us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265330.731918:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 127 00000100:00100000:3.0:1789265330.733113:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533775104 00000100:00100000:3.0:1789265330.733121:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533775104 00000100:00100000:3.0:1789265330.733177:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1789265330.733187:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5574:x1876180533775104:12345-192.168.204.43@tcp:33: 00000004:00080000:3.0:1789265330.763640:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30390us 00000004:00200000:1.0:1789265330.787762:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789265330.787890:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5574:x1876180533775104:12345-192.168.204.43@tcp:33: Request processed in 54701us (57352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265330.787906:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:2.0:1789265331.234264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265331.234421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533775360 00000100:00100000:1.0:1789265331.234431:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533775360 00000100:00100000:1.0:1789265331.234494:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:1.0:1789265331.234504:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5615:x1876180533775360:12345-192.168.204.43@tcp:101: 00010000:00010000:1.0:1789265331.234524:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265331.234607:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92544207dc00/0x8e12577ef818f413 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f832b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265331.234674:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92544207c400/0x8e12577ef818f41a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265331.234838:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92544207c400/0x8e12577ef818f41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265331.234866:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92544207c400/0x8e12577ef818f41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265331.234904:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265331.234907:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265331.234923:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92544207c400/0x8e12577ef818f41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265331.234951:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92544207dc00/0x8e12577ef818f413 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f832b expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265331.234992:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92544207c400/0x8e12577ef818f41a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f832b expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265331.235001:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540cd7aa00) 00010000:00010000:1.0:1789265331.235004:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265331.235007:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207c400, rc 0) 00000100:00100000:1.0:1789265331.235080:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:5615:x1876180533775360:12345-192.168.204.43@tcp:101: Request processed in 577us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265331.235088:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1789265331.616944:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265331.616982:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553719296:0@lo:13: 00000100:00100000:0.0:1789265331.617102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265331.623422:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553719296 00000100:00100000:2.0:1789265331.623447:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553719296 00000100:00100000:2.0:1789265331.623600:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265331.623614:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553719296:12345-0@lo:13: 00002000:00000024:2.0:1789265331.623650:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265331.623784:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553719296:12345-0@lo:13: Request processed in 172us (6681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265331.623792:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789265331.623954:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265331.626383:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c000 x1876180553719296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265331.626426:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553719296:0@lo:13: 00010000:00010000:1.0:1789265331.746074:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265332.766580:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265333.791251:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265333.950243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265333.950579:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533775488 00000100:00100000:2.0:1789265333.950594:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533775488 00000100:00100000:2.0:1789265333.950700:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:2.0:1789265333.950713:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:5667:x1876180533775488:12345-192.168.204.43@tcp:41: 00000004:00000024:2.0:1789265333.950777:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789265333.950892:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:5667:x1876180533775488:12345-192.168.204.43@tcp:41: Request processed in 180us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265333.950900:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00080000:1.0:1789265333.951119:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265333.970090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265333.970262:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533775616 00000100:00100000:2.0:1789265333.970284:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533775616 00000100:00100000:2.0:1789265333.970414:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:2.0:1789265333.970435:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5667:x1876180533775616:12345-192.168.204.43@tcp:13: 00002000:00000024:2.0:1789265333.970494:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265333.970599:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5667:x1876180533775616:12345-192.168.204.43@tcp:13: Request processed in 166us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265333.970608:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00080000:1.0:1789265333.971027:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265333.974786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265333.974976:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533775744 00000100:00100000:2.0:1789265333.974991:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533775744 00000100:00100000:2.0:1789265333.975088:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:2.0:1789265333.975102:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5667:x1876180533775744:12345-192.168.204.43@tcp:13: 00002000:00000024:2.0:1789265333.975151:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789265333.975684:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265333.975752:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:5667:x1876180533775744:12345-192.168.204.43@tcp:13: Request processed in 650us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265333.975762:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:0.0:1789265334.177097:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553719424:0@lo:400: 00000100:00100000:0.0:1789265334.177186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.177261:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553719936:0@lo:400: 00000100:00100000:2.0:1789265334.177270:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553719424 00000100:00100000:2.0:1789265334.177279:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553719424 00000100:00100000:0.0:1789265334.177293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.177322:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265334.177328:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553719808:0@lo:400: 00000100:00100000:2.0:1789265334.177350:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789265334.177360:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553719424:12345-0@lo:400: 00000100:00100000:0.0:1789265334.177395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.177406:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553719424:12345-0@lo:400: Request processed in 48us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.177412:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789265334.177429:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553719424:0@lo:400: 00000100:00100000:2.0:1789265334.177449:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553719808 00000100:00100000:2.0:1789265334.177452:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553719808 00000100:00100000:0.0:1789265334.177455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553719936 00000100:00100000:0.0:1789265334.177457:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553719936 00000100:00100000:2.0:1789265334.177493:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265334.177500:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553719808:12345-0@lo:400: 00000100:00100000:2.0:1789265334.177537:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553719808:12345-0@lo:400: Request processed in 38us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.177564:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265334.178355:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265334.178374:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553719936:12345-0@lo:400: 00000100:00100000:0.0:1789265334.178432:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553719936:12345-0@lo:400: Request processed in 65us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.178439:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789265334.178467:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265334.178473:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789265334.178547:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c700 x1876180553719808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265334.178561:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553719808:0@lo:400: 00000100:00100000:0.0:1789265334.178588:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553719936:0@lo:400: 00000100:00100000:3.0:1789265334.181694:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553719552:0@lo:400: 00000100:00100000:3.0:1789265334.181790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.181865:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553720064:0@lo:400: 00000100:00100000:3.0:1789265334.181892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.181926:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265334.181934:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553719680:0@lo:400: 00000100:00100000:3.0:1789265334.181958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.182056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553719552 00000100:00100000:1.0:1789265334.182064:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553719552 00000100:00100000:1.0:1789265334.182120:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553719680 00000100:00100000:1.0:1789265334.182124:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553719680 00000100:00100000:1.0:1789265334.182149:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265334.182159:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553719552:12345-0@lo:400: 00000100:00100000:1.0:1789265334.182214:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553719552:12345-0@lo:400: Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.182222:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265334.182242:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789265334.182248:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553719680:12345-0@lo:400: 00000100:00100000:1.0:1789265334.182278:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553719680:12345-0@lo:400: Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.182300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265334.182388:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553720064 00000100:00100000:0.0:1789265334.182456:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553720064 00000100:00080000:2.0:1789265334.182609:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265334.182616:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265334.182713:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265334.182723:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553720064:12345-0@lo:400: 00000100:00100000:0.0:1789265334.182765:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553720064:12345-0@lo:400: Request processed in 45us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.182771:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265334.182864:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553719680:0@lo:400: 00000100:00100000:3.0:1789265334.182880:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553719552:0@lo:400: 00010000:00080000:3.0:1789265334.182894:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185dc00 x1876180553720064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265334.182904:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553720064:0@lo:400: 00000100:00100000:0.0:1789265334.686918:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265334.686959:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553720192:0@lo:13: 00000100:00100000:0.0:1789265334.687057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.687889:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553720192 00000100:00100000:2.0:1789265334.687907:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553720192 00000100:00100000:2.0:1789265334.687996:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265334.688010:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553720192:12345-0@lo:13: 00002000:00000024:2.0:1789265334.688045:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265334.688161:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553720192:12345-0@lo:13: Request processed in 154us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.688170:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789265334.694663:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185d880 x1876180553720192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265334.694695:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553720192:0@lo:13: 00000001:00100000:1.0:1789265334.761563:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00010000:00010000:3.0:1789265334.814529:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789265335.281576:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000001:00100000:1.0:1789265335.797624:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00010000:00010000:1.0:1789265335.838787:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265335.937845:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265335.937951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265335.937982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265335.938082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265335.938125:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533776128 00000100:00100000:0.0:1789265335.938138:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533776128 00000100:00100000:0.0:1789265335.938217:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533776256 00000100:00100000:0.0:1789265335.938220:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533776256 00000100:00100000:0.0:1789265335.938250:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:0.0:1789265335.938263:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533776128:12345-192.168.204.43@tcp:400: 00000100:00100000:0.0:1789265335.938390:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533776128:12345-192.168.204.43@tcp:400: Request processed in 129us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265335.938417:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:0.0:1789265335.938437:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1789265335.938443:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533776256:12345-192.168.204.43@tcp:400: 00000100:00100000:0.0:1789265335.938468:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533776256:12345-192.168.204.43@tcp:400: Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265335.938474:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00080000:0.0:1789265335.938490:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265335.938495:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265335.941476:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533776000 00000100:00100000:3.0:1789265335.941508:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533776000 00000100:00100000:3.0:1789265335.941608:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:3.0:1789265335.941624:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533776000:12345-192.168.204.43@tcp:400: 00000100:00100000:3.0:1789265335.941728:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533776000:12345-192.168.204.43@tcp:400: Request processed in 111us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265335.941736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00080000:0.0:1789265335.942192:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265335.948176:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533775872 00000100:00100000:2.0:1789265335.948199:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533775872 00000100:00100000:2.0:1789265335.948294:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 129 00000100:00100000:2.0:1789265335.948306:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:2343:x1876180533775872:12345-192.168.204.43@tcp:400: 00000100:00100000:2.0:1789265335.951404:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:2343:x1876180533775872:12345-192.168.204.43@tcp:400: Request processed in 3077us (13556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265335.951421:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 129 00000100:00100000:3.0:1789265336.737297:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553720320:0@lo:13: 00000100:00100000:3.0:1789265336.737742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265336.737941:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553720320 00000100:00100000:0.0:1789265336.737951:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553720320 00000100:00100000:0.0:1789265336.738042:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265336.738053:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553720320:12345-0@lo:13: 00002000:00000024:0.0:1789265336.738097:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265336.738155:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553720320:12345-0@lo:13: Request processed in 104us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265336.738162:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789265336.738321:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441888700 x1876180553720320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265336.738364:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553720320:0@lo:13: 00000100:00080000:1.0:1789265336.738506:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265336.865048:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265337.209838:0:8282:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789265337.886814:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265338.912673:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265339.294563:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876180553720704:0@lo:400: 00000100:00100000:2.0:1789265339.294646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265339.294726:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789265339.294733:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553720576:0@lo:400: 00000100:00100000:2.0:1789265339.294756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265339.294774:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553721088:0@lo:400: 00000100:00100000:2.0:1789265339.294798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265339.294859:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553720704 00000100:00100000:2.0:1789265339.294868:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553720704 00000100:00100000:2.0:1789265339.294925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553720576 00000100:00100000:2.0:1789265339.294928:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553720576 00000100:00100000:2.0:1789265339.294946:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265339.294954:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876180553720704:12345-0@lo:400: 00000100:00100000:2.0:1789265339.295036:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876180553720704:12345-0@lo:400: Request processed in 82us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265339.295045:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265339.295063:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265339.295070:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553720576:12345-0@lo:400: 00000100:00100000:2.0:1789265339.295098:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553720576:12345-0@lo:400: Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265339.295104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789265339.295124:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265339.295168:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553720576:0@lo:400: 00000100:00100000:2.0:1789265339.295180:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876180553720704:0@lo:400: 00000100:00100000:0.0:1789265339.295541:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553720448:0@lo:400: 00000100:00100000:0.0:1789265339.295578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.295617:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553720960:0@lo:400: 00000100:00100000:0.0:1789265339.295651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.295672:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265339.295678:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553720832:0@lo:400: 00000100:00100000:0.0:1789265339.295712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.295741:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553721088 00000100:00100000:0.0:1789265339.295744:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553721088 00000100:00100000:0.0:1789265339.295780:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553720832 00000100:00100000:0.0:1789265339.295783:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553720832 00000100:00100000:0.0:1789265339.295799:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265339.295805:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553721088:12345-0@lo:400: 00000100:00100000:0.0:1789265339.295843:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553721088:12345-0@lo:400: Request processed in 38us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.295849:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265339.295862:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265339.295868:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553720832:12345-0@lo:400: 00000100:00100000:0.0:1789265339.295897:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553720832:12345-0@lo:400: Request processed in 29us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.295903:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789265339.295925:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265339.295927:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789265339.295944:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185f800 x1876180553720832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265339.295955:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553720832:0@lo:400: 00000100:00100000:0.0:1789265339.295974:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553720960 00000100:00100000:0.0:1789265339.295977:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553720960 00000100:00100000:0.0:1789265339.296277:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265339.296287:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553720960:12345-0@lo:400: 00000100:00100000:0.0:1789265339.296375:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553720960:12345-0@lo:400: Request processed in 90us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.296382:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789265339.296400:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265339.296418:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553720960:0@lo:400: 00010000:00080000:0.0:1789265339.296447:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c380 x1876180553721088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265339.296457:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553721088:0@lo:400: 00000100:00100000:2.0:1789265339.297067:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553720448 00000100:00100000:2.0:1789265339.297075:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553720448 00000100:00100000:2.0:1789265339.297120:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789265339.297129:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553720448:12345-0@lo:400: 00000100:00100000:2.0:1789265339.297196:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553720448:12345-0@lo:400: Request processed in 69us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265339.297203:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789265339.297297:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553720448:0@lo:400: 00000100:00100000:3.0:1789265339.811530:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265339.811557:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553721216:0@lo:13: 00000100:00100000:3.0:1789265339.811659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.813961:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553721216 00000100:00100000:0.0:1789265339.813993:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553721216 00000100:00100000:0.0:1789265339.814067:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265339.814078:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553721216:12345-0@lo:13: 00002000:00000024:0.0:1789265339.814119:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265339.814212:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553721216:12345-0@lo:13: Request processed in 136us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.814220:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789265339.814370:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543be43480 x1876180553721216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265339.814390:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553721216:0@lo:13: 00010000:00010000:0.0:1789265339.964241:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265340.958636:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265341.045919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265341.045971:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265341.046008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265341.046045:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265341.046083:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533776640 00000100:00100000:0.0:1789265341.046094:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533776640 00000100:00100000:0.0:1789265341.046167:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533776768 00000100:00100000:0.0:1789265341.046170:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533776768 00000100:00100000:0.0:1789265341.046188:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1789265341.046215:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533776640:12345-192.168.204.43@tcp:400: 00000100:00100000:0.0:1789265341.046291:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533776640:12345-192.168.204.43@tcp:400: Request processed in 79us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.046299:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1789265341.046318:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:0.0:1789265341.046325:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533776768:12345-192.168.204.43@tcp:400: 00000100:00100000:2.0:1789265341.046492:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533776384 00000100:00100000:2.0:1789265341.046497:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533776384 00000100:00100000:2.0:1789265341.046528:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00100000:2.0:1789265341.046542:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:2343:x1876180533776384:12345-192.168.204.43@tcp:400: 00000100:00100000:2.0:1789265341.046584:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:2343:x1876180533776384:12345-192.168.204.43@tcp:400: Request processed in 42us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.046590:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00080000:1.0:1789265341.046815:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265341.046821:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265341.047514:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533776768:12345-192.168.204.43@tcp:400: Request processed in 1186us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.047523:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:3.0:1789265341.047719:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533776512 00000100:00100000:3.0:1789265341.047726:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533776512 00000100:00080000:2.0:1789265341.049093:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265341.052528:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:1.0:1789265341.052567:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533776512:12345-192.168.204.43@tcp:400: 00000100:00100000:1.0:1789265341.052704:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533776512:12345-192.168.204.43@tcp:400: Request processed in 161us (6694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265341.052714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000020:00000080:3.0:1789265341.682061:0:8431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff06ea0cf0 20000000:00000080:3.0:1789265341.682088:0:8431:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff925441841400 uarg=0000000000000000 20000000:01000000:3.0:1789265341.682900:0:8431:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789265341.682906:0:8431:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789265341.682909:0:8431:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789265341.682917:0:8431:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789265341.682922:0:8431:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789265341.682940:0:8431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789265341.682943:0:8431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789265341.683263:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789265341.683266:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789265341.687520:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789265341.688455:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789265341.688534:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789265341.688573:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789265341.688588:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789265341.688591:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789265341.693597:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789265341.694935:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789265341.694997:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789265341.695241:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789265341.695263:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789265341.695265:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789265341.700593:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789265341.701301:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789265341.701393:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789265341.701432:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789265341.701446:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789265341.701450:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789265341.702464:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789265341.702864:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789265341.702924:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789265341.702957:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1789265341.702971:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789265341.702993:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703013:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f317 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703032:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f341 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703039:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f36b expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703046:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f379 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703053:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f387 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703060:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703067:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703077:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703085:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703093:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703154:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703183:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 9 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703198:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721344:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265341.703319:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703327:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 9 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703369:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721472:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265341.703402:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703410:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 18 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703419:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544188b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721600:0@lo:104: 00000100:00100000:1.0:1789265341.703462:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265341.703503:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703510:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 18 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703518:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544188a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721728:0@lo:104: 00000100:00100000:1.0:1789265341.703541:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265341.703568:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f387 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703576:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f387 expref: 18 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703583:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544188bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721856:0@lo:104: 00010000:00010000:1.0:1789265341.703603:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f379 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703610:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f379 expref: 18 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703617:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544188b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721984:0@lo:104: 00010000:00010000:1.0:1789265341.703636:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f36b expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703642:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f36b expref: 18 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703649:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553722112:0@lo:104: 00010000:00010000:1.0:1789265341.703686:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f341 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703694:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f341 expref: 18 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703701:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553722240:0@lo:104: 00010000:00010000:1.0:1789265341.703722:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f317 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.703741:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f317 expref: 18 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.703749:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553722368:0@lo:104: 00000100:00100000:1.0:1789265341.703767:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254085d7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265341.704160:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265341.704182:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.704194:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.704203:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.704211:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.704220:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.704229:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553721600 00000100:00100000:2.0:1789265341.704236:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553721600 00000100:00100000:2.0:1789265341.704276:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553721728 00000100:00100000:2.0:1789265341.704279:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553721728 00000100:00100000:2.0:1789265341.704288:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553721856 00000100:00100000:2.0:1789265341.704290:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553721856 00000100:00100000:2.0:1789265341.704297:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553721984 00000100:00100000:2.0:1789265341.704299:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553721984 00000100:00100000:2.0:1789265341.704307:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553722112 00000100:00100000:2.0:1789265341.704309:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553722112 00000100:00100000:2.0:1789265341.704316:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553722240 00000100:00100000:2.0:1789265341.704318:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553722240 00000100:00100000:2.0:1789265341.704326:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553722368 00000100:00100000:2.0:1789265341.704328:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553722368 00000100:00100000:2.0:1789265341.704368:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265341.704376:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:8431:x1876180553721600:12345-0@lo:104: 00010000:00010000:2.0:1789265341.704390:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.704463:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265341.704469:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+9:8431:x1876180553721600:12345-0@lo:104: Request processed in 94us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.704477:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265341.704494:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265341.704500:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540809f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+8:8431:x1876180553721728:12345-0@lo:104: 00010000:00010000:2.0:1789265341.704507:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.704540:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265341.704544:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540809f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+8:8431:x1876180553721728:12345-0@lo:104: Request processed in 45us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.704550:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265341.704580:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265341.704585:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+7:8431:x1876180553721856:12345-0@lo:104: 00010000:00010000:2.0:1789265341.704592:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.704612:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265341.704616:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+7:8431:x1876180553721856:12345-0@lo:104: Request processed in 32us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.704621:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265341.704630:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265341.704634:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+6:8431:x1876180553721984:12345-0@lo:104: 00010000:00010000:2.0:1789265341.704640:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.704958:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789265341.704964:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+6:8431:x1876180553721984:12345-0@lo:104: Request processed in 330us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.704971:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265341.704984:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265341.704990:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:8431:x1876180553722112:12345-0@lo:104: 00010000:00010000:2.0:1789265341.704996:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705020:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789265341.705025:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:8431:x1876180553722112:12345-0@lo:104: Request processed in 37us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.705030:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265341.705041:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265341.705046:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:8431:x1876180553722240:12345-0@lo:104: 00010000:00010000:2.0:1789265341.705053:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705079:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789265341.705084:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:8431:x1876180553722240:12345-0@lo:104: Request processed in 38us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.705089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265341.705161:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265341.705168:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:8431:x1876180553722368:12345-0@lo:104: 00010000:00010000:2.0:1789265341.705175:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705210:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789265341.705215:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:8431:x1876180553722368:12345-0@lo:104: Request processed in 48us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.705221:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789265341.705243:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789265341.705249:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705257:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265341.705262:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705270:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.705278:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.705284:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265341.705319:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705326:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.705369:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705377:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f3c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f3d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705401:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789265341.705404:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705411:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027dfc00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265341.705415:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705422:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.705429:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.705434:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265341.705451:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705459:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.705465:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705472:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254027dfc00/0x8e12577ef818f3a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f3aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705483:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789265341.705486:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705504:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027de200 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265341.705507:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705513:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.705519:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.705523:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265341.705536:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705541:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.705556:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705561:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254027de200/0x8e12577ef818f387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f38e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705570:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789265341.705573:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705578:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027dea00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265341.705581:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.705597:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.706217:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.706224:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265341.706243:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706248:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.706255:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706262:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254027dea00/0x8e12577ef818f379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f380 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706273:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265341.706276:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706281:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027de800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265341.706283:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706288:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.706294:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.706306:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265341.706319:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706324:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.706328:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706363:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254027de800/0x8e12577ef818f36b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f372 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706372:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265341.706375:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706380:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265341.706382:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706388:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.706393:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.706397:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265341.706409:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706414:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.706426:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706433:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403136200/0x8e12577ef818f341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f348 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706442:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265341.706445:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706451:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027dee00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265341.706454:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706461:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.706467:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.706472:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265341.706483:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706488:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.706492:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706498:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254027dee00/0x8e12577ef818f317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f31e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.706509:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265341.706515:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265341.706517:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265341.706524:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265341.706552:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553722496:0@lo:103: 00000100:00100000:2.0:1789265341.706600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.706630:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553723008:0@lo:103: 00000100:00100000:2.0:1789265341.706647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265341.707140:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544188b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721600:0@lo:104: 00000100:00100000:1.0:1789265341.707154:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544188a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721728:0@lo:104: 00000100:00100000:1.0:1789265341.707162:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544188bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721856:0@lo:104: 00000100:00100000:1.0:1789265341.707171:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544188b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721984:0@lo:104: 00000100:00100000:1.0:1789265341.707180:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553722112:0@lo:104: 00000100:00100000:1.0:1789265341.707188:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553722240:0@lo:104: 00000100:00100000:1.0:1789265341.707197:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553722368:0@lo:104: 00000100:00100000:2.0:1789265341.707261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789265341.707270:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553722624:0@lo:103: 00000100:00100000:2.0:1789265341.707297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265341.708630:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553722880:0@lo:103: 00000100:00100000:0.0:1789265341.708701:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553722752:0@lo:103: 00000100:00100000:2.0:1789265341.710030:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553723136:0@lo:103: 00000100:00100000:2.0:1789265341.710080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265341.710108:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553722496 00000100:00100000:3.0:1789265341.710115:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553722496 00010000:00010000:3.0:1789265341.710162:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 19 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265341.710188:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553723008 00000100:00100000:3.0:1789265341.710190:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553723008 00010000:00010000:3.0:1789265341.710219:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f36b expref: 20 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265341.710230:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553722624 00000100:00100000:3.0:1789265341.710233:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553722624 00010000:00010000:3.0:1789265341.710243:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 21 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265341.710255:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265341.710263:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+21:3306:x1876180553722496:12345-0@lo:103: 00010000:00010000:3.0:1789265341.710276:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265341.710281:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 21 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710290:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 21 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710307:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136400/0x8e12577ef818f3d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f3c6 expref: 21 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710325:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265341.710375:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+20:3306:x1876180553722496:12345-0@lo:103: Request processed in 112us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265341.710383:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265341.710400:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265341.710406:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553723008:12345-0@lo:103: 00010000:00010000:3.0:1789265341.710415:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265341.710419:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f36b expref: 19 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710437:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f36b expref: 19 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710447:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027df600/0x8e12577ef818f372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f36b expref: 19 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710458:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265341.710483:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:3306:x1876180553723008:12345-0@lo:103: Request processed in 79us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265341.710489:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265341.710500:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265341.710507:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:3306:x1876180553722624:12345-0@lo:103: 00010000:00010000:3.0:1789265341.710515:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265341.710519:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 17 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710526:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 17 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710535:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400030e00/0x8e12577ef818f3aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f3a3 expref: 17 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.710544:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265341.710567:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:3306:x1876180553722624:12345-0@lo:103: Request processed in 61us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265341.710572:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265341.711138:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553722496:0@lo:103: 00000100:00100000:2.0:1789265341.711147:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553723008:0@lo:103: 00000100:00100000:2.0:1789265341.711171:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553722624:0@lo:103: 00000100:00100000:2.0:1789265341.711189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.711253:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553723264:0@lo:103: 00000100:00100000:2.0:1789265341.711278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.711536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265341.711579:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553723136 00000100:00100000:0.0:1789265341.711585:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553723136 00010000:00010000:0.0:1789265341.711620:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f341 expref: 16 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265341.711634:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553722752 00000100:00100000:0.0:1789265341.711637:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553722752 00010000:00010000:0.0:1789265341.711647:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f387 expref: 17 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265341.711671:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553723264 00000100:00100000:0.0:1789265341.711681:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553723264 00010000:00010000:0.0:1789265341.711694:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f317 expref: 18 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265341.711706:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265341.711711:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:3306:x1876180553723136:12345-0@lo:103: 00010000:00010000:0.0:1789265341.712293:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265341.712301:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f341 expref: 18 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.712314:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f341 expref: 18 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.712363:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207c600/0x8e12577ef818f348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f341 expref: 18 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.712382:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265341.712443:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:3306:x1876180553723136:12345-0@lo:103: Request processed in 730us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.712451:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265341.712477:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265341.712486:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:3304:x1876180553722752:12345-0@lo:103: 00010000:00010000:0.0:1789265341.712495:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265341.712500:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f387 expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.712507:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f387 expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.712515:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207d400/0x8e12577ef818f38e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f387 expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.712531:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265341.712557:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:3304:x1876180553722752:12345-0@lo:103: Request processed in 73us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.712563:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265341.712575:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265341.712582:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:3304:x1876180553723264:12345-0@lo:103: 00010000:00010000:0.0:1789265341.712590:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265341.712594:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f317 expref: 14 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.715300:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f317 expref: 14 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.715321:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207de00/0x8e12577ef818f31e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f317 expref: 14 pid: 5825 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.715349:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265341.715424:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3304:x1876180553723264:12345-0@lo:103: Request processed in 2841us (4143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.715433:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265341.715503:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553722752:0@lo:103: 00000100:00100000:0.0:1789265341.715513:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553723264:0@lo:103: 00000100:00100000:0.0:1789265341.715547:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553723136:0@lo:103: 00000100:00100000:2.0:1789265341.717169:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553722880 00000100:00100000:2.0:1789265341.717185:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553722880 00010000:00010000:2.0:1789265341.717230:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f379 expref: 13 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265341.717256:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265341.717265:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:3305:x1876180553722880:12345-0@lo:103: 00010000:00010000:2.0:1789265341.717296:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265341.717303:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f379 expref: 13 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.717314:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f379 expref: 13 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.717344:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027df800/0x8e12577ef818f380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f379 expref: 13 pid: 5826 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.717363:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265341.717413:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:3305:x1876180553722880:12345-0@lo:103: Request processed in 150us (5877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.717419:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265341.717486:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553722880:0@lo:103: 00000100:00100000:2.0:1789265341.720713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265341.720760:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265341.720796:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533777024 00000100:00100000:2.0:1789265341.720806:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533777024 00010000:00010000:2.0:1789265341.720846:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 10 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265341.720869:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533776896 00000100:00100000:2.0:1789265341.720871:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533776896 00010000:00010000:2.0:1789265341.720881:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 11 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265341.720896:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265341.720904:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f248648a-8946-448c-8146-af0e3c141002+11:2342:x1876180533777024:12345-192.168.204.43@tcp:103: 00010000:00010000:2.0:1789265341.720944:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265341.720950:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 11 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.720961:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 11 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.720987:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265341.721054:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f248648a-8946-448c-8146-af0e3c141002+11:2342:x1876180533777024:12345-192.168.204.43@tcp:103: Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.721061:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265341.721080:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1789265341.721085:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533776896:12345-192.168.204.43@tcp:103: 00010000:00010000:2.0:1789265341.721093:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265341.721097:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 10 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721106:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 10 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721118:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721125:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721140:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721157:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721163:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721169:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721176:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207dc00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265341.721182:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721189:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721198:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721208:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265341.721228:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533776896:12345-192.168.204.43@tcp:103: Request processed in 142us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.721234:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00010000:00010000:1.0:1789265341.721581:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137c00/0x8e12577ef818f3e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82d0 expref: 9 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.721596:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721344:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265341.721608:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207d600/0x8e12577ef818f3e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82c9 expref: 8 pid: 5825 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265341.721617:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1876180553721472:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265341.721667:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.721677:0:8431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.721695:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.721702:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207dc00/0x8e12577ef818f421 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265341.857175:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553723392:0@lo:13: 00000100:00100000:2.0:1789265341.857264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265341.857481:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553723392 00000100:00100000:1.0:1789265341.857492:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553723392 00000100:00100000:1.0:1789265341.857571:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265341.857581:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553723392:12345-0@lo:13: 00002000:00000024:1.0:1789265341.857621:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265341.857686:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553723392:12345-0@lo:13: Request processed in 106us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265341.857694:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789265341.857754:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441889180 x1876180553723392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265341.857774:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553723392:0@lo:13: 00000100:00080000:2.0:1789265341.857937:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265342.000477:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265343.006608:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265343.070466:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265343.070491:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9253050fe800 from 39 10000000:01000000:2.0:1789265343.070497:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265343.070541:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.070553:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.070564:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265343.071418:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553723520:0@lo:101: 00000100:00100000:2.0:1789265343.071498:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.071611:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c292a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265343.081587:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553723520 00000100:00100000:0.0:1789265343.081602:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553723520 00000100:00100000:0.0:1789265343.081680:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789265343.081707:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+12:5831:x1876180553723520:12345-0@lo:101: 00010000:00010000:0.0:1789265343.081729:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265343.081755:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925400030a00/0x8e12577ef818f42f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f428 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.081788:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400030a00/0x8e12577ef818f42f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f428 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.081802:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925400030a00/0x8e12577ef818f42f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f428 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.081814:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925400030a00, rc 0) 00000100:00100000:0.0:1789265343.081916:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553723520:12345-0@lo:101: Request processed in 210us (10418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265343.082221:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789265343.083214:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553723520:0@lo:101: 00010000:00010000:3.0:1789265343.083237:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.083262:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265343.083369:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553723648:0@lo:501: 00000100:00100000:3.0:1789265343.083418:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265343.083468:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a497b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.084214:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553723648 00000100:00100000:2.0:1789265343.084222:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553723648 00000100:00100000:2.0:1789265343.084279:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789265343.084289:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553723648:12345-0@lo:501: 00000100:00100000:2.0:1789265343.084621:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553723648:12345-0@lo:501: Request processed in 333us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.084640:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789265343.085275:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553723648:0@lo:501: 00000100:00100000:3.0:1789265343.085319:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553723776:0@lo:503: 00000100:00100000:3.0:1789265343.085388:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265343.085462:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a497b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.089414:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553723776 00000100:00100000:1.0:1789265343.089433:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553723776 00000100:00100000:1.0:1789265343.089590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789265343.089601:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553723776:12345-0@lo:503: 00000100:00100000:1.0:1789265343.089898:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:5831:x1876180553723776:12345-0@lo:503: Request processed in 298us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.089906:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789265343.090600:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553723776:0@lo:503: 00000100:00100000:1.0:1789265343.091178:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8448:1876180553723904:0@lo:502: 00000100:00100000:1.0:1789265343.091250:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.091297:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254085d7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.091745:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553723904 00000100:00100000:3.0:1789265343.091753:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553723904 00000100:00100000:3.0:1789265343.091804:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789265343.091824:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:8448:x1876180553723904:12345-0@lo:502: 00000100:00100000:3.0:1789265343.092096:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:8448:x1876180553723904:12345-0@lo:502: Request processed in 282us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.092103:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789265343.093731:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8448:1876180553723904:0@lo:502: 00000100:00100000:1.0:1789265343.093834:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8448:1876180553724032:0@lo:502: 00000100:00100000:1.0:1789265343.093905:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.093961:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254085d7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.094585:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553724032 00000100:00100000:3.0:1789265343.094593:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553724032 00000100:00100000:3.0:1789265343.094663:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265343.094674:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+13:8448:x1876180553724032:12345-0@lo:502: 00000100:00100000:1.0:1789265343.096385:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8448:1876180553724032:0@lo:502: 00000040:00080000:1.0:1789265343.096434:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789265343.096658:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789265343.096684:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265343.096696:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.096708:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265343.096719:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789265343.096722:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789265343.096724:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789265343.096757:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.096765:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.096787:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265343.096824:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724160:0@lo:101: 00000100:00100000:0.0:1789265343.096872:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.096916:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.097147:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553724160 00000100:00100000:2.0:1789265343.097155:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553724160 00000100:00100000:2.0:1789265343.097438:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789265343.097449:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553724160:12345-0@lo:101: 00010000:00010000:2.0:1789265343.097465:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265343.097480:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403137600/0x8e12577ef818f43d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f436 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.097506:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137600/0x8e12577ef818f43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f436 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.097528:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403137600/0x8e12577ef818f43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f436 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.097538:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137600, rc 0) 00000100:00100000:2.0:1789265343.097584:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553724160:12345-0@lo:101: Request processed in 138us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.097592:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265343.097709:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724160:0@lo:101: 00010000:00010000:0.0:1789265343.097724:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.097733:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265343.097792:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724288:0@lo:501: 00000100:00100000:0.0:1789265343.097834:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.097864:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.097987:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8448:x1876180553724032:12345-0@lo:502: Request processed in 3314us (4081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.097996:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265343.098045:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553724288 00000100:00100000:3.0:1789265343.098050:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553724288 00000100:00100000:1.0:1789265343.099066:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789265343.099092:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553724288:12345-0@lo:501: 00000100:00100000:1.0:1789265343.099571:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553724288:12345-0@lo:501: Request processed in 486us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.099579:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789265343.099702:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724288:0@lo:501: 00000100:00100000:0.0:1789265343.099746:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724416:0@lo:503: 00000100:00100000:0.0:1789265343.099790:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.099891:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553724416 00000100:00100000:2.0:1789265343.099898:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553724416 00000100:00100000:2.0:1789265343.099925:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789265343.099931:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553724416:12345-0@lo:503: 00000100:00100000:2.0:1789265343.100066:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553724416:12345-0@lo:503: Request processed in 134us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.100086:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789265343.107552:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.107719:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724416:0@lo:503: 00000100:00100000:1.0:1789265343.111094:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8449:1876180553724544:0@lo:502: 00000100:00100000:1.0:1789265343.111206:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.111253:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254085d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.111480:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553724544 00000100:00100000:2.0:1789265343.111488:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553724544 00000100:00100000:2.0:1789265343.111534:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789265343.111543:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8449:x1876180553724544:12345-0@lo:502: 00000100:00100000:2.0:1789265343.111797:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8449:x1876180553724544:12345-0@lo:502: Request processed in 254us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.111806:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789265343.112057:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441889180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8449:1876180553724544:0@lo:502: 00000020:01000000:0.0:1789265343.112099:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265343.112108:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265343.112111:0:8449:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265343.112123:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789265343.112155:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8449:1876180553724672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265343.112203:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.112224:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.112478:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553724672 00000100:00100000:2.0:1789265343.112483:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553724672 00000100:00100000:2.0:1789265343.112515:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789265343.112523:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8449:x1876180553724672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265343.112675:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:8449:x1876180553724672:12345-0@lo:502:llog_process_th.0 Request processed in 153us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.112688:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789265343.118129:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8449:1876180553724672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265343.118188:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265343.118205:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265343.118207:0:8449:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265343.118221:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789265343.121567:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789265343.121613:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789265343.121637:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.121651:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265343.121665:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265343.121668:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92543b68a800 from 39 10000000:01000000:2.0:1789265343.121672:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265343.121720:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.121728:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.121741:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265343.121768:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265343.121855:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.121914:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c292480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265343.121984:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553724800 00000100:00100000:0.0:1789265343.121991:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553724800 00000100:00100000:0.0:1789265343.122049:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789265343.122060:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:5831:x1876180553724800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265343.122082:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265343.122096:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925400031800/0x8e12577ef818f44b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f444 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.122119:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925400031800/0x8e12577ef818f44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f444 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.122129:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925400031800/0x8e12577ef818f44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f444 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.122137:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925400031800, rc 0) 00000100:00100000:0.0:1789265343.122194:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553724800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265343.122199:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789265343.123521:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265343.123542:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.123575:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265343.123662:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265343.123704:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.123748:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c292480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.123804:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553724928 00000100:00100000:1.0:1789265343.123811:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553724928 00000100:00100000:1.0:1789265343.123857:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789265343.123865:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553724928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.124168:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553724928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.124176:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789265343.125406:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553724928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265343.125464:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553725056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265343.125525:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.125562:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c292480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.125949:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553725056 00000100:00100000:1.0:1789265343.125956:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553725056 00000100:00100000:1.0:1789265343.126006:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265343.126014:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553725056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.126222:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553725056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.126229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789265343.126386:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553725056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265343.127056:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8450:1876180553725184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265343.127113:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.127146:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c2929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.127284:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553725184 00000100:00100000:1.0:1789265343.127289:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553725184 00000100:00100000:1.0:1789265343.127324:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789265343.127364:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:8450:x1876180553725184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265343.127548:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:8450:x1876180553725184:12345-0@lo:502:llog_process_th.0 Request processed in 217us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.127555:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789265343.131267:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8450:1876180553725184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265343.131414:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8450:1876180553725312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265343.131494:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.131545:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c2929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.131703:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553725312 00000100:00100000:1.0:1789265343.131711:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553725312 00000100:00100000:1.0:1789265343.131766:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265343.131776:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:8450:x1876180553725312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265343.132277:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:8450:x1876180553725312:12345-0@lo:502:llog_process_th.0 Request processed in 501us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.132285:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789265343.134483:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8450:1876180553725312:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789265343.134549:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789265343.134754:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789265343.134789:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265343.134801:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.134821:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265343.134832:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789265343.134836:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789265343.134839:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265343.134877:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.134884:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.134893:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265343.134914:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553725440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265343.134977:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.135036:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.135109:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553725440 00000100:00100000:3.0:1789265343.135117:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553725440 00000100:00100000:3.0:1789265343.135175:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789265343.135185:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:5831:x1876180553725440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265343.135199:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265343.135215:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441885e00/0x8e12577ef818f459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f452 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.135238:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885e00/0x8e12577ef818f459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f452 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.135248:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441885e00/0x8e12577ef818f459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f452 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.135257:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885e00, rc 0) 00000100:00100000:3.0:1789265343.135306:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553725440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.135314:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789265343.135668:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553725440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265343.135684:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265343.135707:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265343.135760:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553725568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265343.135788:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.135819:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c2929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.138994:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553725568 00000100:00100000:1.0:1789265343.139011:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553725568 00000100:00100000:1.0:1789265343.139090:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265343.139102:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553725568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.140324:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553725568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1216us (4526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.140356:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789265343.140548:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553725568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265343.140607:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553725696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265343.140678:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.140717:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.140767:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553725696 00000100:00100000:1.0:1789265343.140773:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553725696 00000100:00100000:1.0:1789265343.140842:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265343.140851:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553725696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.141046:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553725696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.141054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789265343.143032:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553725696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265343.143308:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8451:1876180553725824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265343.143403:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.160576:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.170175:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553725824 00000100:00100000:2.0:1789265343.170195:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553725824 00000100:00100000:2.0:1789265343.170267:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789265343.170278:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:8451:x1876180553725824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265343.170583:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:8451:x1876180553725824:12345-0@lo:502:llog_process_th.0 Request processed in 306us (27179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.170591:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265343.170885:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8451:1876180553725824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265343.170925:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265343.170935:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265343.170938:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265343.170950:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789265343.170986:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8451:1876180553725952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265343.171043:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.171073:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.172140:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553725952 00000100:00100000:1.0:1789265343.172150:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553725952 00000100:00100000:1.0:1789265343.172211:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265343.172219:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:8451:x1876180553725952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265343.172462:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:8451:x1876180553725952:12345-0@lo:502:llog_process_th.0 Request processed in 242us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.172470:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265343.172802:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8451:1876180553725952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265343.172847:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265343.172853:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265343.172856:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265343.172865:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789265343.174366:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789265343.174402:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789265343.174413:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.174427:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265343.174441:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789265343.174444:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff925409ebd800 from 39 10000000:01000000:1.0:1789265343.174448:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265343.174488:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.174496:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.174521:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265343.174547:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.174608:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.174659:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265343.174736:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553726080 00000100:00100000:0.0:1789265343.174743:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553726080 00000100:00100000:0.0:1789265343.174788:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789265343.174798:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553726080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265343.174825:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265343.174843:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9254013c2200/0x8e12577ef818f467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f460 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.174866:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254013c2200/0x8e12577ef818f467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f460 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.174875:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9254013c2200/0x8e12577ef818f467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f460 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.174895:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9254013c2200, rc 0) 00000100:00100000:0.0:1789265343.174931:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553726080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265343.174937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265343.175127:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265343.175141:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.175150:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265343.175971:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.176013:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.176223:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b416c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.186849:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553726208 00000100:00100000:3.0:1789265343.186870:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553726208 00000100:00100000:3.0:1789265343.186955:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265343.186967:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553726208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265343.187530:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553726208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 564us (11515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.187539:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265343.187753:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.187826:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.187880:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.187920:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b416c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.188037:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553726336 00000100:00100000:2.0:1789265343.188045:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553726336 00000100:00100000:2.0:1789265343.188085:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789265343.188094:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553726336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265343.188472:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553726336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 379us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.188480:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265343.189548:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265343.191592:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8452:1876180553726464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265343.191693:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265343.191745:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c2929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.193293:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553726464 00000100:00100000:3.0:1789265343.193306:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553726464 00000100:00100000:3.0:1789265343.193645:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789265343.193657:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:8452:x1876180553726464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265343.193974:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:8452:x1876180553726464:12345-0@lo:502:llog_process_th.0 Request processed in 319us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.193982:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789265343.197794:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8452:1876180553726464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265343.202994:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8452:1876180553726592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265343.203092:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265343.203142:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff92542fc37000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.205521:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553726592 00000100:00100000:2.0:1789265343.205541:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553726592 00000100:00100000:2.0:1789265343.205617:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265343.205639:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:8452:x1876180553726592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265343.205966:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:8452:x1876180553726592:12345-0@lo:502:llog_process_th.0 Request processed in 329us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.205974:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789265343.206222:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8452:1876180553726592:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789265343.206261:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789265343.206419:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789265343.206451:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265343.206462:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.206484:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265343.206499:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789265343.206502:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789265343.206505:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265343.206536:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.206545:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.206553:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265343.206573:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.206611:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.206663:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b416c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.206816:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553726720 00000100:00100000:3.0:1789265343.206821:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553726720 00000100:00100000:3.0:1789265343.206866:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789265343.206874:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553726720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265343.206886:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265343.206900:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441885200/0x8e12577ef818f475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f46e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.206922:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885200/0x8e12577ef818f475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f46e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.206932:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441885200/0x8e12577ef818f475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f46e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.206941:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885200, rc 0) 00000100:00100000:3.0:1789265343.206983:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553726720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.206999:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789265343.207216:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265343.207229:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.207237:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265343.207284:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.207309:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.207505:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b416c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.207751:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553726848 00000100:00100000:2.0:1789265343.207757:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553726848 00000100:00100000:3.0:1789265343.208921:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789265343.208934:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553726848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265343.209803:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553726848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 868us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.209814:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789265343.210065:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.210117:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.210166:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.210256:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265343.210808:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553726976 00000100:00100000:0.0:1789265343.210816:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553726976 00000100:00100000:1.0:1789265343.210871:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789265343.210881:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553726976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.211095:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553726976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.211102:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265343.211312:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553726976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.212018:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8453:1876180553727104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265343.212171:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.212211:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.212370:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553727104 00000100:00100000:3.0:1789265343.212376:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553727104 00000100:00100000:3.0:1789265343.212420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789265343.212429:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8453:x1876180553727104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265343.212675:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8453:x1876180553727104:12345-0@lo:502:llog_process_th.0 Request processed in 246us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.212682:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789265343.212762:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8453:1876180553727104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265343.212788:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265343.212799:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265343.212802:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789265343.212809:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789265343.212831:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8453:1876180553727232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265343.212864:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265343.213065:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265343.213321:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553727232 00000100:00100000:2.0:1789265343.213327:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553727232 00000100:00100000:2.0:1789265343.213498:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789265343.213506:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8453:x1876180553727232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265343.213759:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8453:x1876180553727232:12345-0@lo:502:llog_process_th.0 Request processed in 253us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265343.213767:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789265343.213798:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8453:1876180553727232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265343.213825:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265343.213830:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265343.213832:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789265343.213841:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789265343.214060:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789265343.214085:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789265343.214097:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.214109:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265343.214120:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789265343.214123:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925402d54d28 from 1 10000000:01000000:0.0:1789265343.214126:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789265343.214218:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.214587:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.214599:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265343.214620:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553727360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265343.214676:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.214706:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265343.214886:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553727360 00000100:00100000:3.0:1789265343.214893:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553727360 00000100:00100000:3.0:1789265343.214978:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789265343.214989:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553727360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265343.215002:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265343.215021:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441884c00/0x8e12577ef818f483 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f47c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.215048:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441884c00/0x8e12577ef818f483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f47c expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.215059:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441884c00/0x8e12577ef818f483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f47c expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.215081:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884c00, rc 0) 00000100:00100000:3.0:1789265343.215116:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553727360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.215123:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789265343.215209:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553727360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265343.215232:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f483 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.215242:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f483 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265343.215302:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553727488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265343.215327:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265343.215754:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265343.215936:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553727488 00000100:00100000:1.0:1789265343.215942:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553727488 00000100:00100000:1.0:1789265343.216142:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789265343.216151:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553727488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265343.216492:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553727488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (1163us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265343.216499:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789265343.216592:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553727488:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789265343.216665:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265343.216673:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f483 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.216682:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f483 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265343.604736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265343.605705:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533777152 00000100:00100000:1.0:1789265343.605719:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533777152 00000100:00100000:1.0:1789265343.605806:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 164 00000100:00100000:1.0:1789265343.605818:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+8:5588:x1876180533777152:12345-192.168.204.43@tcp:101: 00010000:00010000:1.0:1789265343.605838:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265343.605860:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207da00/0x8e12577ef818f48a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8332 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.605893:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207da00/0x8e12577ef818f48a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8332 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.605906:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207da00/0x8e12577ef818f48a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8332 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.605915:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207da00, rc 0) 00000100:00100000:1.0:1789265343.607091:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+9:5588:x1876180533777152:12345-192.168.204.43@tcp:101: Request processed in 1267us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.607100:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 164 00000100:00100000:2.0:1789265343.611068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265343.611288:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533777280 00000100:00100000:3.0:1789265343.611303:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533777280 00000100:00100000:3.0:1789265343.611429:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 165 00000100:00100000:3.0:1789265343.611443:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+9:5588:x1876180533777280:12345-192.168.204.43@tcp:501: 00000100:00100000:3.0:1789265343.613949:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+9:5588:x1876180533777280:12345-192.168.204.43@tcp:501: Request processed in 2488us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.613966:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 165 00000100:00100000:2.0:1789265343.617882:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265343.618001:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533777408 00000100:00100000:1.0:1789265343.618014:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533777408 00000100:00100000:1.0:1789265343.618254:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:1.0:1789265343.618284:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+9:5588:x1876180533777408:12345-192.168.204.43@tcp:503: 00000100:00100000:1.0:1789265343.618635:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+9:5588:x1876180533777408:12345-192.168.204.43@tcp:503: Request processed in 353us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.618644:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:2.0:1789265343.622942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265343.623288:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533777536 00000100:00100000:3.0:1789265343.623301:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533777536 00000100:00100000:3.0:1789265343.623472:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 167 00000100:00100000:3.0:1789265343.623485:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+9:6062:x1876180533777536:12345-192.168.204.43@tcp:502: 00000100:00100000:3.0:1789265343.624041:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+9:6062:x1876180533777536:12345-192.168.204.43@tcp:502: Request processed in 555us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.624051:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 167 00000100:00100000:2.0:1789265343.626730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265343.626978:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533777664 00000100:00100000:1.0:1789265343.626992:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533777664 00000100:00100000:1.0:1789265343.627105:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 168 00000100:00100000:1.0:1789265343.627117:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+9:6062:x1876180533777664:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265343.627687:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+9:6062:x1876180533777664:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 568us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.627697:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 168 00000100:00100000:2.0:1789265343.634082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265343.634503:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533777792 00000100:00100000:3.0:1789265343.634518:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533777792 00000100:00100000:1.0:1789265343.636609:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 169 00000100:00100000:1.0:1789265343.636647:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+9:5588:x1876180533777792:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265343.636681:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265343.636708:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207c800/0x8e12577ef818f491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8339 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.636747:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207c800/0x8e12577ef818f491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8339 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.636762:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207c800/0x8e12577ef818f491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8339 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.636772:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207c800, rc 0) 00000100:00100000:1.0:1789265343.636869:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:5588:x1876180533777792:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 236us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.636898:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 169 00000100:00100000:1.0:1789265343.641110:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265343.641267:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533777920 00000100:00100000:3.0:1789265343.641280:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533777920 00000100:00100000:3.0:1789265343.641487:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 170 00000100:00100000:3.0:1789265343.641744:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:5588:x1876180533777920:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265343.642254:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:5588:x1876180533777920:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 755us (1156us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265343.642266:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 170 00010000:00010000:2.0:1789265344.030938:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265344.415714:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553727872:0@lo:400:kworker.0 00000100:00100000:2.0:1789265344.415818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265344.415896:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265344.415904:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553728000:0@lo:400:kworker.0 00000100:00100000:2.0:1789265344.415949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265344.415998:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553727872 00000100:00100000:2.0:1789265344.416008:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553727872 00000100:00100000:2.0:1789265344.416098:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265344.416113:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553727872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265344.416180:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553727872:12345-0@lo:400:kworker.0 Request processed in 72us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.416188:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265344.416219:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553728000 00000100:00100000:2.0:1789265344.416223:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553728000 00000100:00100000:3.0:1789265344.416236:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553727872:0@lo:400:kworker.0 00000100:00100000:2.0:1789265344.416273:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265344.416282:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553728000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265344.416325:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553728000:12345-0@lo:400:kworker.0 Request processed in 44us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.416351:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789265344.416369:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265344.416374:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789265344.416496:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185d180 x1876180553728000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265344.416509:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553728000:0@lo:400:kworker.0 00000100:00100000:0.0:1789265344.417537:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553727744:0@lo:400:kworker.0 00000100:00100000:0.0:1789265344.417634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265344.417906:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553728256:0@lo:400:kworker.0 00000100:00100000:0.0:1789265344.417950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265344.417995:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789265344.418003:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553727616:0@lo:400:kworker.0 00000100:00100000:0.0:1789265344.418040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265344.418064:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553728128:0@lo:400:kworker.0 00000100:00100000:0.0:1789265344.418090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265344.418257:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553728256 00000100:00100000:0.0:1789265344.418267:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553728256 00000100:00100000:0.0:1789265344.418353:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265344.418362:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553728256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265344.418423:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553728256:12345-0@lo:400:kworker.0 Request processed in 62us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265344.418432:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265344.418504:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553727744 00000100:00100000:3.0:1789265344.418510:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553727744 00000100:00100000:1.0:1789265344.418521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553727616 00000100:00100000:1.0:1789265344.418528:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553727616 00000100:00100000:3.0:1789265344.418553:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553728128 00000100:00100000:3.0:1789265344.418558:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553728128 00000100:00100000:1.0:1789265344.418571:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789265344.418583:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553727616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265344.418587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265344.418607:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553727744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265344.418647:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553727616:12345-0@lo:400:kworker.0 Request processed in 67us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265344.418655:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789265344.418661:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553727744:12345-0@lo:400:kworker.0 Request processed in 64us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265344.418670:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265344.418690:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265344.418698:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553728128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265344.418725:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553728128:12345-0@lo:400:kworker.0 Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265344.418732:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789265344.418835:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265344.418840:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265344.419050:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553727616:0@lo:400:kworker.0 00000100:00100000:0.0:1789265344.419072:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553728128:0@lo:400:kworker.0 00000100:00100000:0.0:1789265344.419083:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553727744:0@lo:400:kworker.0 00010000:00080000:0.0:1789265344.419098:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185ea00 x1876180553728256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265344.419110:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553728256:0@lo:400:kworker.0 00000020:00000080:3.0:1789265344.865237:0:8490:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcca85a690 20000000:00000080:3.0:1789265344.865261:0:8490:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff925441842000 uarg=0000000000000000 20000000:01000000:3.0:1789265344.865319:0:8490:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789265344.865326:0:8490:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789265344.865655:0:8490:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789265344.868274:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789265344.868894:0:8490:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789265344.878415:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789265344.878488:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789265344.878539:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789265344.878569:0:8490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789265344.878606:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.878629:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403137400/0x8e12577ef818f20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f206 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.878638:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f268 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.878646:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f333 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.878656:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.878663:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.878710:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.878727:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 9 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265344.878743:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876180553728384:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265344.878891:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f333 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.878901:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f333 expref: 18 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265344.878924:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876180553728512:0@lo:104: 00000100:00100000:0.0:1789265344.878971:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265344.879006:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f268 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.879015:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f268 expref: 18 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265344.879023:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876180553728640:0@lo:104: 00000100:00100000:0.0:1789265344.879044:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265344.879061:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403137400/0x8e12577ef818f20d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f206 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265344.879069:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925403137400/0x8e12577ef818f20d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f206 expref: 18 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265344.879077:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876180553728768:0@lo:104: 00000100:00100000:0.0:1789265344.879094:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265344.879449:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265344.879472:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265344.879483:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553728512 00000100:00100000:2.0:1789265344.879492:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553728512 00000100:00100000:2.0:1789265344.879544:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553728640 00000100:00100000:2.0:1789265344.879548:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553728640 00000100:00100000:2.0:1789265344.879558:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553728768 00000100:00100000:2.0:1789265344.879560:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553728768 00000100:00100000:2.0:1789265344.879575:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265344.879586:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:8490:x1876180553728512:12345-0@lo:104: 00010000:00010000:2.0:1789265344.879614:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.879694:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265344.879701:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:8490:x1876180553728512:12345-0@lo:104: Request processed in 118us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.879708:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265344.879729:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265344.879736:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:8490:x1876180553728640:12345-0@lo:104: 00010000:00010000:2.0:1789265344.879744:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.879775:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265344.879780:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:8490:x1876180553728640:12345-0@lo:104: Request processed in 46us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.879786:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265344.879819:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265344.879826:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:8490:x1876180553728768:12345-0@lo:104: 00010000:00010000:2.0:1789265344.879832:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.879857:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265344.879862:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:8490:x1876180553728768:12345-0@lo:104: Request processed in 37us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.879868:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789265344.879885:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265344.879891:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.879899:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265344.879910:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.879920:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265344.879928:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265344.879935:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265344.879982:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.879989:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265344.880018:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880025:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030000/0x8e12577ef818f333 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f33a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880039:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265344.880042:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880047:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207ce00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265344.880050:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880055:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265344.880071:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265344.880075:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265344.880087:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880092:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265344.880097:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880104:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92544207ce00/0x8e12577ef818f268 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f26f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880113:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265344.880115:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880120:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136c00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265344.880122:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880128:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265344.880133:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265344.880138:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265344.880154:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880160:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265344.880177:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880184:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef818f206 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f20d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880197:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265344.880199:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265344.880200:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265344.880207:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265344.880223:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553728896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265344.880254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265344.880290:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265344.880296:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553729024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265344.880317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265344.880369:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553729152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265344.880395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265344.880435:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553728896 00000100:00100000:2.0:1789265344.880443:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553728896 00010000:00010000:2.0:1789265344.880470:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f333 expref: 19 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265344.880489:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553729024 00000100:00100000:2.0:1789265344.880492:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553729024 00010000:00010000:2.0:1789265344.880507:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f268 expref: 20 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265344.880532:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553729152 00000100:00100000:2.0:1789265344.880535:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553729152 00010000:00010000:2.0:1789265344.880546:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403137400/0x8e12577ef818f20d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f206 expref: 21 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265344.880557:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265344.880564:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+21:3304:x1876180553728896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265344.880577:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265344.880583:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f333 expref: 21 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880607:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f333 expref: 21 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880631:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265344.880663:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+21:3304:x1876180553728896:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.880669:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265344.880684:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265344.880690:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+20:3304:x1876180553729024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265344.880697:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265344.880701:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f268 expref: 20 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880710:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f268 expref: 20 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880719:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265344.880751:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+20:3304:x1876180553729024:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.880757:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265344.880771:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265344.880777:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553729152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265344.880784:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265344.880788:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403137400/0x8e12577ef818f20d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f206 expref: 19 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880796:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403137400/0x8e12577ef818f20d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f206 expref: 19 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.880805:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265344.880835:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553729152:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.880841:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265344.880887:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553729152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265344.880913:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553729024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265344.880919:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553728896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265344.881808:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027de000/0x8e12577ef818f33a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f333 expref: 18 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265344.881825:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876180553728512:0@lo:104: 00010000:00010000:0.0:1789265344.881836:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254027dfa00/0x8e12577ef818f26f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f268 expref: 17 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265344.881848:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876180553728640:0@lo:104: 00010000:00010000:0.0:1789265344.881857:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137400/0x8e12577ef818f20d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f206 expref: 16 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265344.881884:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876180553728768:0@lo:104: 00000100:00100000:0.0:1789265344.884683:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1876180553728384:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265344.884737:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265344.886441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265344.886585:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533778048 00000100:00100000:2.0:1789265344.886609:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533778048 00010000:00010000:2.0:1789265344.886661:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 10 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265344.886703:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:2.0:1789265344.886714:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f248648a-8946-448c-8146-af0e3c141002+10:2343:x1876180533778048:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265344.886733:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265344.886754:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 10 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886768:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 10 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886791:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137200/0x8e12577ef818f3f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8301 expref: 10 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886813:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886822:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886840:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886848:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886856:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886863:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886869:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254013c3600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265344.886874:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886882:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886913:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265344.886925:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265344.887571:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f248648a-8946-448c-8146-af0e3c141002+9:2343:x1876180533778048:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 853us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.887583:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00010000:00010000:3.0:1789265344.887893:0:8490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265344.887923:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265344.887930:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254013c3600/0x8e12577ef818f498 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265344.927196:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553729280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265344.927298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265344.927406:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553729280 00000100:00100000:0.0:1789265344.927416:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553729280 00000100:00100000:0.0:1789265344.927487:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265344.927498:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553729280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265344.927546:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265344.927623:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553729280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265344.927631:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789265344.928643:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543be40a80 x1876180553729280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265344.928672:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553729280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265345.054815:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265346.014739:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265346.014747:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9253050fe800 from 4 10000000:01000000:0.0:1789265346.014752:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265346.014906:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.014918:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.014928:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265346.015008:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553729408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265346.015083:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.015142:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.017086:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553729408 00000100:00100000:1.0:1789265346.017100:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553729408 00000100:00100000:1.0:1789265346.017166:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789265346.017177:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553729408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265346.017195:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265346.017215:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f49f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.017241:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f49f expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.017252:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f49f expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.017262:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207de00, rc 0) 00000100:00100000:1.0:1789265346.017359:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553729408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.017366:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789265346.018085:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553729408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265346.018107:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.018119:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265346.018190:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553729536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265346.018229:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.018272:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.018349:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553729536 00000100:00100000:1.0:1789265346.018355:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553729536 00000100:00100000:1.0:1789265346.018386:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265346.018394:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553729536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265346.018655:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553729536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.018662:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789265346.019597:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553729536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265346.019642:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553729664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265346.019698:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.019739:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.019784:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553729664 00000100:00100000:1.0:1789265346.019790:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553729664 00000100:00100000:1.0:1789265346.019841:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789265346.019850:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553729664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265346.020029:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553729664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.020037:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789265346.020888:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553729664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265346.031685:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8535:1876180553729792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265346.031778:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.031845:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b416c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.034419:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553729792 00000100:00100000:1.0:1789265346.034432:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553729792 00000100:00100000:1.0:1789265346.034504:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789265346.034516:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:8535:x1876180553729792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265346.035036:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:8535:x1876180553729792:12345-0@lo:502:llog_process_th.0 Request processed in 520us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.035045:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789265346.035151:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441888380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8535:1876180553729792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265346.035188:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265346.035198:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265346.035201:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265346.035208:0:8535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9253050fe800 00000020:00000080:3.0:1789265346.035210:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265346.035325:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8535:1876180553729920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265346.035405:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265346.035434:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265346.037860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553729920 00000100:00100000:0.0:1789265346.037874:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553729920 00000100:00100000:0.0:1789265346.037933:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789265346.037944:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:8535:x1876180553729920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265346.038215:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:8535:x1876180553729920:12345-0@lo:502:llog_process_th.0 Request processed in 273us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.038232:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789265346.042020:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8535:1876180553729920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265346.042069:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265346.042078:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265346.042080:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789265346.042085:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789265346.042167:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789265346.042187:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265346.042197:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.042209:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265346.042219:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265346.042222:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92543b68a800 from 4 10000000:01000000:2.0:1789265346.042224:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265346.042257:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.042264:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.042301:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.042321:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265346.042414:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.042460:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403280300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.043079:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553730048 00000100:00100000:1.0:1789265346.043089:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553730048 00000100:00100000:1.0:1789265346.043141:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789265346.043160:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553730048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265346.043175:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265346.043191:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f4ad expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.043216:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.043227:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.043235:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207ce00, rc 0) 00000100:00100000:1.0:1789265346.043306:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553730048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.043313:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789265346.044104:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265346.044121:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.044132:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265346.044197:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265346.044246:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.044507:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553730176 00000100:00100000:1.0:1789265346.044513:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553730176 00000100:00100000:1.0:1789265346.044542:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789265346.044548:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553730176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265346.044602:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.045216:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553730176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 666us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.045226:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789265346.046094:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265346.046145:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265346.046202:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265346.047704:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265346.048813:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553730304 00000100:00100000:2.0:1789265346.048826:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553730304 00000100:00100000:2.0:1789265346.048911:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789265346.048924:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553730304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265346.049818:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553730304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 894us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.049829:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789265346.049976:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265346.051606:0:8540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8540:1876180553730432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265346.051681:0:8540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.052003:0:8540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254032803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.052439:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553730432 00000100:00100000:1.0:1789265346.052447:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553730432 00000100:00100000:1.0:1789265346.052495:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789265346.052504:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8540:x1876180553730432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265346.052760:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8540:x1876180553730432:12345-0@lo:502:llog_process_th.0 Request processed in 256us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.052776:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789265346.053473:0:8540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8540:1876180553730432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265346.053513:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265346.053525:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265346.053528:0:8540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789265346.053536:0:8540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92543b68a800 00000020:00000080:2.0:1789265346.053539:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265346.053651:0:8540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8540:1876180553730560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265346.053699:0:8540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.053743:0:8540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254032803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265346.054457:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553730560 00000100:00100000:3.0:1789265346.054466:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553730560 00000100:00100000:3.0:1789265346.054520:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789265346.054530:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8540:x1876180553730560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265346.054767:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:8540:x1876180553730560:12345-0@lo:502:llog_process_th.0 Request processed in 239us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.054774:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789265346.055583:0:8540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8540:1876180553730560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265346.055621:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265346.055628:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265346.055630:0:8540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789265346.055635:0:8540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789265346.055806:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789265346.055905:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265346.055920:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.055934:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265346.055946:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265346.055949:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925409ebd800 from 4 10000000:01000000:0.0:1789265346.055952:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265346.055989:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.055997:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.056006:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265346.056028:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265346.056076:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.056120:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265346.056244:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553730688 00000100:00100000:2.0:1789265346.056251:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553730688 00000100:00100000:2.0:1789265346.056304:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789265346.056314:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553730688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265346.057803:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265346.057839:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f4bb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.057873:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.057885:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.057894:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136200, rc 0) 00000100:00100000:2.0:1789265346.057964:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553730688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1650us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.057972:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789265346.058146:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265346.058165:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.058176:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265346.058259:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265346.058294:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.058360:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265346.058959:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553730816 00000100:00100000:2.0:1789265346.058968:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553730816 00000100:00100000:2.0:1789265346.059004:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789265346.059013:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553730816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265346.059675:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553730816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 659us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.059690:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789265346.059749:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265346.059799:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265346.060655:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.060697:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254032809c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265346.061390:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553730944 00000100:00100000:0.0:1789265346.061400:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553730944 00000100:00100000:0.0:1789265346.068700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789265346.068722:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553730944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265346.068985:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553730944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 271us (8332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.068993:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789265346.074579:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553730944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265346.074859:0:8544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8544:1876180553731072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265346.074932:0:8544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.074974:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553731072 00000100:00100000:2.0:1789265346.074980:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553731072 00000100:00100000:2.0:1789265346.075020:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789265346.075029:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:8544:x1876180553731072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265346.075253:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:8544:x1876180553731072:12345-0@lo:502:llog_process_th.0 Request processed in 224us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.075260:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789265346.075364:0:8544:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403280300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265346.075378:0:8544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8544:1876180553731072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265346.075404:0:8544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265346.075413:0:8544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265346.075415:0:8544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789265346.075422:0:8544:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff925409ebd800 00000020:00000080:2.0:1789265346.075425:0:8544:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265346.075860:0:8544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8544:1876180553731200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265346.075899:0:8544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.075926:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553731200 00000100:00100000:2.0:1789265346.075931:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553731200 00000100:00100000:2.0:1789265346.075957:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789265346.075964:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:8544:x1876180553731200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265346.076103:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:8544:x1876180553731200:12345-0@lo:502:llog_process_th.0 Request processed in 139us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.076110:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789265346.076149:0:8544:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265346.076163:0:8544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:8544:1876180553731200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265346.076183:0:8544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265346.076188:0:8544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265346.076190:0:8544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789265346.076193:0:8544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789265346.076250:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789265346.076274:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265346.076283:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.076295:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.080457:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265346.175810:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265346.175950:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533778304 00000100:00100000:3.0:1789265346.175962:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533778304 00000100:00100000:3.0:1789265346.176053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:3.0:1789265346.176065:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533778304:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265346.176147:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533778304:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.176155:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00080000:2.0:1789265346.176408:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265346.192379:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265346.192418:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265346.192444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265346.192474:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533778432 00000100:00100000:2.0:1789265346.192484:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533778432 00000100:00100000:2.0:1789265346.192548:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533778560 00000100:00100000:2.0:1789265346.192552:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533778560 00000100:00100000:2.0:1789265346.192582:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:2.0:1789265346.192593:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533778432:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265346.192663:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533778432:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.192671:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:2.0:1789265346.192689:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:2.0:1789265346.192696:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533778560:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265346.192721:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533778560:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.192727:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00080000:2.0:1789265346.192742:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265346.192746:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265346.194067:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533778176 00000100:00100000:3.0:1789265346.194077:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533778176 00000100:00100000:3.0:1789265346.194127:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 187 00000100:00100000:3.0:1789265346.194137:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+9:2342:x1876180533778176:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265346.194193:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+9:2342:x1876180533778176:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 59us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.194215:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 187 00000100:00100000:3.0:1789265346.679034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265346.679130:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533778688 00000100:00100000:0.0:1789265346.679142:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533778688 00000100:00100000:0.0:1789265346.679207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 188 00000100:00100000:0.0:1789265346.679217:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+9:5588:x1876180533778688:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265346.679234:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265346.679255:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8340 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.679282:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.679293:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.679302:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9254013c3000, rc 0) 00000100:00100000:0.0:1789265346.679381:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:5588:x1876180533778688:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 166us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.679401:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 188 00000100:00100000:0.0:1789265346.695924:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265346.698578:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533778816 00000100:00100000:2.0:1789265346.698594:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533778816 00000100:00100000:3.0:1789265346.699735:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:3.0:1789265346.699748:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:5588:x1876180533778816:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265346.700076:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:5588:x1876180533778816:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 329us (4158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.700085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:3.0:1789265346.704293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265346.707394:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533778944 00000100:00100000:2.0:1789265346.707415:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533778944 00000100:00100000:3.0:1789265346.710707:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:3.0:1789265346.710724:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:5588:x1876180533778944:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265346.710998:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:5588:x1876180533778944:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 276us (6717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.711007:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:3.0:1789265346.713634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265346.715080:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533779072 00000100:00100000:2.0:1789265346.715094:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533779072 00000100:00100000:2.0:1789265346.715159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 191 00000100:00100000:2.0:1789265346.715171:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:6125:x1876180533779072:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265346.724567:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:6125:x1876180533779072:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 9376us (10929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.724586:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 191 00000100:00100000:3.0:1789265346.728639:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265346.728768:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533779200 00000100:00100000:1.0:1789265346.728784:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533779200 00000100:00100000:1.0:1789265346.728876:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 192 00000100:00100000:1.0:1789265346.728892:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:6125:x1876180533779200:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265346.729311:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:6125:x1876180533779200:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 422us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.729321:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 192 00000100:00100000:0.0:1789265346.992652:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553731328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265346.992745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.992829:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553731328 00000100:00100000:0.0:1789265346.992837:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553731328 00000100:00100000:0.0:1789265346.992893:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265346.992902:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553731328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265346.992940:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265346.992983:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553731328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.992990:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789265346.994137:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265346.994184:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402cdd500 x1876180553731328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265346.994208:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553731328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265347.116219:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265348.126555:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265349.151312:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265349.535402:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553731456:0@lo:400:kworker.0 00000100:00100000:2.0:1789265349.535846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265349.535916:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553731968:0@lo:400:kworker.0 00000100:00100000:2.0:1789265349.535972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265349.536005:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265349.536012:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553731840:0@lo:400:kworker.0 00000100:00100000:2.0:1789265349.536058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265349.541269:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553731840 00000100:00100000:1.0:1789265349.541291:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553731840 00000100:00100000:1.0:1789265349.541401:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265349.541418:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553731840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.541557:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553731840:12345-0@lo:400:kworker.0 Request processed in 146us (5498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.541565:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265349.541594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553731968 00000100:00100000:1.0:1789265349.541598:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553731968 00000100:00100000:1.0:1789265349.541630:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265349.541637:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553731968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.541673:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553731968:12345-0@lo:400:kworker.0 Request processed in 36us (5700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.541692:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789265349.541711:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265349.541717:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265349.541764:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553731712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.541810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265349.541848:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789265349.541855:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553731584:0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.541877:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265349.541892:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553732096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.541912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265349.541939:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553731456 00000100:00100000:1.0:1789265349.541943:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553731456 00000100:00100000:1.0:1789265349.541982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789265349.541988:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553731456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.542020:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553731456:12345-0@lo:400:kworker.0 Request processed in 32us (6175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.542026:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789265349.542053:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553732096 00000100:00100000:1.0:1789265349.542057:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553732096 00000100:00100000:1.0:1789265349.542083:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265349.542089:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553732096:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789265349.542632:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265349.542643:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553731712 00000100:00100000:0.0:1789265349.542647:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553731712 00000100:00100000:0.0:1789265349.542676:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553731584 00000100:00100000:0.0:1789265349.542679:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553731584 00000100:00100000:0.0:1789265349.542693:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265349.542698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553731712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265349.542742:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553731712:12345-0@lo:400:kworker.0 Request processed in 44us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.542748:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265349.542768:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265349.542774:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553731584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265349.542802:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553731584:12345-0@lo:400:kworker.0 Request processed in 28us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.542808:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789265349.542822:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265349.542869:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553731584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265349.542880:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553731712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.543011:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553732096:12345-0@lo:400:kworker.0 Request processed in 921us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.543019:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789265349.543066:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c000 x1876180553731840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265349.543090:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553731840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.543179:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553731456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265349.543195:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553731968:0@lo:400:kworker.0 00010000:00080000:0.0:1789265349.544352:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c700 x1876180553732096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265349.544367:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553732096:0@lo:400:kworker.0 00000100:00100000:2.0:1789265350.047617:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265350.047648:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553732224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265350.047732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265350.047808:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553732224 00000100:00100000:2.0:1789265350.047818:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553732224 00000100:00100000:2.0:1789265350.047885:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265350.047896:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553732224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265350.047936:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265350.047983:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553732224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.047991:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789265350.048032:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540c33b800 x1876180553732224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265350.048053:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553732224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265350.177431:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265351.207062:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265351.291937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265351.291982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265351.292011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265351.292035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265351.292071:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533779584 00000100:00100000:2.0:1789265351.292081:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533779584 00000100:00100000:2.0:1789265351.292147:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533779712 00000100:00100000:2.0:1789265351.292149:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533779712 00000100:00100000:2.0:1789265351.292174:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265351.292184:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533779584:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265351.292263:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533779584:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265351.292272:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265351.292289:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1789265351.292295:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533779712:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265351.292316:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533779712:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 21us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265351.292321:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1789265351.292355:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533779456 00000100:00100000:2.0:1789265351.292358:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533779456 00000100:00100000:2.0:1789265351.292391:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:2.0:1789265351.292397:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533779456:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265351.292422:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533779456:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265351.292427:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00080000:2.0:1789265351.292444:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265351.292448:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265351.292449:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265351.292665:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533779328 00000100:00100000:1.0:1789265351.292670:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533779328 00000100:00100000:1.0:1789265351.292703:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 194 00000100:00100000:1.0:1789265351.292711:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533779328:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265351.292750:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533779328:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 41us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.292757:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 194 00000001:02000400:0.0:1789265351.485317:0:8788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1789265352.096590:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265352.096642:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553732352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265352.096779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265352.097172:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553732352 00000100:00100000:2.0:1789265352.097186:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553732352 00000100:00100000:2.0:1789265352.097282:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265352.097294:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553732352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265352.097376:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265352.097520:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553732352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 228us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265352.097543:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789265352.097652:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265352.098495:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402cdd500 x1876180553732352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265352.098534:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553732352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265352.228757:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265353.247063:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265354.270561:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265354.654690:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553732608:0@lo:400:kworker.0 00000100:00100000:3.0:1789265354.654770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265354.654823:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553733120:0@lo:400:kworker.0 00000100:00100000:3.0:1789265354.654850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265354.654883:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265354.654889:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553732736:0@lo:400:kworker.0 00000100:00100000:3.0:1789265354.654909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265354.655029:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553733120 00000100:00100000:3.0:1789265354.655043:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553733120 00000100:00100000:3.0:1789265354.655097:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265354.655111:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553733120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265354.655160:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553733120:12345-0@lo:400:kworker.0 Request processed in 56us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265354.655167:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265354.655188:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553732608 00000100:00100000:3.0:1789265354.655192:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553732608 00000100:00100000:3.0:1789265354.655213:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553732736 00000100:00100000:3.0:1789265354.655216:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553732736 00000100:00100000:3.0:1789265354.655245:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265354.655252:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553732608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265354.655280:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553732608:12345-0@lo:400:kworker.0 Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265354.655286:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265354.655295:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265354.655302:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553732736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265354.655326:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553732736:12345-0@lo:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265354.655593:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553732480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265354.655631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265354.655657:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553732992:0@lo:400:kworker.0 00000100:00100000:1.0:1789265354.655678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265354.655693:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265354.655710:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553732864:0@lo:400:kworker.0 00000100:00100000:1.0:1789265354.655735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265354.656111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265354.656129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553732992 00000100:00100000:3.0:1789265354.656133:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553732992 00000100:00100000:3.0:1789265354.656158:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265354.656164:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553732992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265354.656217:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553732992:12345-0@lo:400:kworker.0 Request processed in 53us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265354.656223:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789265354.656249:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265354.656254:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265354.656263:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553732864 00000100:00100000:3.0:1789265354.656266:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553732864 00000100:00100000:3.0:1789265354.656309:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265354.656317:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553732864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265354.659584:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553732480 00000100:00100000:2.0:1789265354.659599:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553732480 00000100:00100000:2.0:1789265354.659658:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789265354.659667:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553732480:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789265354.659771:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9253077f4e00 x1876180553732864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265354.659787:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553732864:0@lo:400:kworker.0 00000100:00100000:1.0:1789265354.659805:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553732992:0@lo:400:kworker.0 00000100:00100000:3.0:1789265354.660762:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553732864:12345-0@lo:400:kworker.0 Request processed in 4440us (5018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265354.660775:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265354.662185:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553732736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265354.662215:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553732608:0@lo:400:kworker.0 00010000:00080000:0.0:1789265354.662229:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9253077f4a80 x1876180553733120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265354.662239:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553733120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265354.662779:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553732480:12345-0@lo:400:kworker.0 Request processed in 3110us (7144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265354.662789:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789265354.662897:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553732480:0@lo:400:kworker.0 00000100:00080000:2.0:1789265354.663101:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265355.167563:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553733248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265355.167639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265355.167718:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553733248 00000100:00100000:3.0:1789265355.167726:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553733248 00000100:00100000:3.0:1789265355.167777:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265355.167786:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553733248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265355.167816:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265355.167856:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553733248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265355.167863:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789265355.167905:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9253077f4000 x1876180553733248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265355.167923:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553733248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265355.295477:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265355.820575:0:9032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing yml_node 00010000:00010000:2.0:1789265356.333469:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265356.413620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265356.413723:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265356.416479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265356.416540:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533780096 00000100:00100000:3.0:1789265356.416552:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533780096 00000100:00100000:0.0:1789265356.416696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533779968 00000100:00100000:0.0:1789265356.416711:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533779968 00000100:00100000:1.0:1789265356.417561:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533779840 00000100:00100000:1.0:1789265356.417572:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533779840 00000100:00100000:1.0:1789265356.418178:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 196 00000100:00100000:1.0:1789265356.418198:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:2345:x1876180533779840:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265356.418435:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:2345:x1876180533779840:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 242us (4832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265356.418444:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 196 00000100:00100000:3.0:1789265356.418585:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:3.0:1789265356.418616:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2341:x1876180533780096:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:3.0:1789265356.418668:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f405 00000100:00080000:3.0:1789265356.418685:0:6678:0:(import.c:65:import_set_state_nolock()) ffff925441443800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789265356.418739:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789265356.418747:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789265356.418839:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1789265356.418863:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533779968:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265356.418906:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533779968:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 48us (5184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265356.418914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1789265356.420855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265356.421726:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789265356.421746:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789265356.423116:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+2:2341:x1876180533780096:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 4504us (6634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.423131:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:3.0:1789265356.423172:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533780224 00000100:00100000:3.0:1789265356.423181:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533780224 00000100:00100000:3.0:1789265356.423242:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:3.0:1789265356.423264:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2341:x1876180533780224:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:3.0:1789265356.424114:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f40c 00000100:00080000:3.0:1789265356.424130:0:6678:0:(import.c:65:import_set_state_nolock()) ffff925441444800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265356.424183:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1789265356.424654:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265356.426603:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+2:2341:x1876180533780224:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 3333us (5755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.426618:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00080000:2.0:1789265356.427530:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265356.427540:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265356.427543:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265357.214653:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553733376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265357.214749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265357.214919:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553733376 00000100:00100000:3.0:1789265357.214928:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553733376 00000100:00080000:0.0:1789265357.215043:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265357.215084:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265357.215098:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553733376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265357.215138:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265357.215745:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553733376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 650us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265357.215757:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789265357.217634:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402cdc700 x1876180553733376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265357.217668:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553733376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265357.342557:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265358.366751:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265359.390606:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265359.774898:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553733888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.775092:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265359.775116:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553733504:0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.775193:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553734016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.775252:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553733760:0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.775321:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265359.775327:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553733632:0@lo:400:kworker.0 00000100:00100000:0.0:1789265359.775374:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553734016 00000100:00100000:3.0:1789265359.775384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.775386:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553734016 00000100:00100000:3.0:1789265359.775406:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553734144:0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775433:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.775463:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553733504 00000100:00100000:0.0:1789265359.775466:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553733760 00000100:00100000:3.0:1789265359.775468:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553733504 00000100:00100000:0.0:1789265359.775472:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553733760 00000100:00100000:0.0:1789265359.775501:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553733632 00000100:00100000:0.0:1789265359.775503:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553733632 00000100:00100000:3.0:1789265359.775520:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789265359.775525:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265359.775537:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553733504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265359.775539:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553734016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775608:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553733504:12345-0@lo:400:kworker.0 Request processed in 76us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.775621:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553734016:12345-0@lo:400:kworker.0 Request processed in 87us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.775633:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789265359.775637:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265359.775660:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265359.775669:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553733760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775682:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265359.775693:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789265359.775713:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553733760:12345-0@lo:400:kworker.0 Request processed in 45us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.775717:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789265359.775722:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265359.775732:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265359.775738:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265359.775744:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553733632:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789265359.775759:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265359.775782:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553733632:12345-0@lo:400:kworker.0 Request processed in 41us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.775789:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265359.775850:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553733632:0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775864:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553733760:0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775917:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553733504:0@lo:400:kworker.0 00000100:00100000:3.0:1789265359.775930:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553734016:0@lo:400:kworker.0 00000100:00100000:2.0:1789265359.776156:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553733888 00000100:00100000:2.0:1789265359.776162:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553733888 00000100:00100000:2.0:1789265359.776215:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553734144 00000100:00100000:2.0:1789265359.776219:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553734144 00000100:00100000:2.0:1789265359.776247:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265359.776256:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553733888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265359.776317:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553733888:12345-0@lo:400:kworker.0 Request processed in 63us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265359.776324:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265359.776360:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265359.776371:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553734144:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789265359.776390:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540c338000 x1876180553733888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265359.776414:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553733888:0@lo:400:kworker.0 00000100:00100000:0.0:1789265359.776427:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553734144:12345-0@lo:400:kworker.0 Request processed in 57us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.776436:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789265359.777038:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265359.777044:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265359.777076:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540c33b100 x1876180553734144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265359.777089:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553734144:0@lo:400:kworker.0 00000100:00100000:2.0:1789265360.286814:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553734272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265360.286942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265360.287052:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553734272 00000100:00100000:2.0:1789265360.287062:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553734272 00000100:00100000:2.0:1789265360.287134:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265360.287145:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553734272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265360.287218:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265360.287275:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553734272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265360.287282:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789265360.287379:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540c338000 x1876180553734272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265360.287404:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553734272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265360.415387:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265360.694755:0:9226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.106 00000001:00100000:3.0:1789265360.884932:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:3.0:1789265360.884941:0:6704:0:(genops.c:885:class_export_put()) final put ffff925441443000/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:1.0:1789265360.885260:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441443000/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa for lustre-OST0000 00000020:00000080:1.0:1789265360.885317:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925441443800 for lustre-OST0000 00000001:00100000:1.0:1789265361.425533:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:1.0:1789265361.425544:0:7630:0:(genops.c:885:class_export_put()) final put ffff925441446000/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:3.0:1789265361.425675:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441446000/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa for lustre-OST0001 00000020:00000080:3.0:1789265361.425814:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925441444800 for lustre-OST0001 00010000:00010000:1.0:1789265361.438552:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265361.526182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265361.526231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265361.526302:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533780352 00000100:00100000:2.0:1789265361.526312:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533780352 00000100:00100000:2.0:1789265361.526385:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 198 00000100:00100000:2.0:1789265361.526394:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:2345:x1876180533780352:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265361.526470:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:2345:x1876180533780352:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 68us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.526478:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 198 00000100:00100000:3.0:1789265361.526813:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533780480 00000100:00100000:3.0:1789265361.526818:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533780480 00000100:00100000:3.0:1789265361.526869:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:3.0:1789265361.526881:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533780480:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265361.526917:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533780480:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 42us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265361.526923:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00080000:0.0:1789265361.527031:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265362.334857:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265362.334888:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553734400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265362.334974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265362.335143:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553734400 00000100:00100000:3.0:1789265362.335153:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553734400 00000100:00100000:3.0:1789265362.335230:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265362.335248:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553734400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265362.335320:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265362.335393:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553734400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265362.335400:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789265362.335527:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265362.335735:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402cdc700 x1876180553734400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265362.335756:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553734400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265362.462664:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265363.361943:0:9325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.106 00010000:00010000:1.0:1789265363.486479:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265364.511902:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265364.895067:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553734528:0@lo:400:kworker.0 00000100:00100000:1.0:1789265364.895146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265364.895290:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553735040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265364.895321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265364.895386:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265364.895393:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553734912:0@lo:400:kworker.0 00000100:00100000:1.0:1789265364.895420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265364.895625:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553734784:0@lo:400:kworker.0 00000100:00100000:2.0:1789265364.895656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265364.895707:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789265364.895713:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553734656:0@lo:400:kworker.0 00000100:00100000:2.0:1789265364.895734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265364.895761:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553735168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265364.895781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265364.895811:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553734912 00000100:00100000:2.0:1789265364.895818:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553734912 00000100:00100000:2.0:1789265364.895873:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553735168 00000100:00100000:2.0:1789265364.895877:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553735168 00000100:00100000:2.0:1789265364.895898:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265364.895906:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553734912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265364.895953:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553734912:12345-0@lo:400:kworker.0 Request processed in 47us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265364.895954:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553735040 00000100:00100000:3.0:1789265364.895958:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553735040 00000100:00100000:2.0:1789265364.895960:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265364.895975:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265364.895980:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553735168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265364.896008:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553735168:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265364.896013:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789265364.896033:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265364.896037:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265364.896039:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265364.896042:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553734784 00000100:00100000:3.0:1789265364.896045:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553734784 00000100:00100000:2.0:1789265364.896053:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553734656 00000100:00100000:2.0:1789265364.896055:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553734656 00000100:00100000:3.0:1789265364.896066:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265364.896076:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553735040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265364.896084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265364.896089:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553734784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265364.896150:0:9189:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789265364.896150:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553734528 00000100:00100000:0.0:1789265364.896153:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553734528 00000100:00100000:1.0:1789265364.896158:0:9189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00080000:1.0:1789265364.896191:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c700 x1876180553734912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265364.896191:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789265364.896198:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553734528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265364.896227:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553734912:0@lo:400:kworker.0 00000100:00100000:1.0:1789265364.896244:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553735040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265364.896409:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265364.896416:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553734656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265364.899029:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553735040:12345-0@lo:400:kworker.0 Request processed in 2946us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265364.899044:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265364.900310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553734784:12345-0@lo:400:kworker.0 Request processed in 4216us (4649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265364.900357:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789265364.900411:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185fb80 x1876180553735168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265364.900430:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553735168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265364.900454:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553734784:0@lo:400:kworker.0 00000100:00100000:0.0:1789265364.900926:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553734528:12345-0@lo:400:kworker.0 Request processed in 4726us (5778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265364.900936:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789265364.900992:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553734528:0@lo:400:kworker.0 00000100:00080000:2.0:1789265364.901836:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265364.902317:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553734656:12345-0@lo:400:kworker.0 Request processed in 5896us (6576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265364.902328:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265364.906220:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553734656:0@lo:400:kworker.0 00000100:00100000:0.0:1789265365.417321:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265365.417363:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553735296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265365.417653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.417798:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553735296 00000100:00100000:0.0:1789265365.417806:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553735296 00000100:00100000:0.0:1789265365.418273:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265365.418283:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553735296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265365.418319:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265365.418487:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553735296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.418495:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789265365.425550:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c000 x1876180553735296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265365.425580:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553735296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265365.535174:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265365.671944:0:9424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.106 00010000:00010000:1.0:1789265366.559951:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265366.645056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265366.645135:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533780608 00000100:00100000:3.0:1789265366.645147:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533780608 00000100:00100000:3.0:1789265366.645235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 200 00000100:00100000:3.0:1789265366.645247:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533780608:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265366.645507:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533780608:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265366.645528:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 200 00000100:00100000:2.0:1789265366.660621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265366.660759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533780736 00000100:00100000:3.0:1789265366.660770:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533780736 00000100:00100000:3.0:1789265366.660871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:3.0:1789265366.660883:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533780736:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265366.660969:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533780736:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 89us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265366.660977:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00080000:2.0:1789265366.661191:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1789265367.144674:0:9472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 12 22:09:24 EDT 2026 00000100:00100000:1.0:1789265367.454752:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265367.457504:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553735424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265367.457608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265367.458968:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553735424 00000100:00100000:0.0:1789265367.458982:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553735424 00000100:00080000:2.0:1789265367.459113:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265367.459168:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265367.459180:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553735424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265367.459223:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265367.459312:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553735424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.459319:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789265367.459417:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185ea00 x1876180553735424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265367.459437:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553735424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265367.582626:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265368.610007:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265369.630990:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265370.016595:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553735552:0@lo:400:kworker.0 00000100:00100000:3.0:1789265370.016678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265370.016852:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553735552 00000100:00100000:0.0:1789265370.016860:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553735552 00000100:00100000:0.0:1789265370.016915:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789265370.016926:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553735552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017253:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553735936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265370.017317:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265370.017323:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553736064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265370.017404:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553735680:0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265370.017446:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553736192:0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265370.017508:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265370.017514:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553735808:0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265370.017567:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553735936 00000100:00100000:1.0:1789265370.017572:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553735936 00000100:00100000:1.0:1789265370.017608:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553736192 00000100:00100000:1.0:1789265370.017611:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553736192 00000100:00100000:1.0:1789265370.017634:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265370.017643:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553735936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017681:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553735936:12345-0@lo:400:kworker.0 Request processed in 40us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265370.017689:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265370.017708:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265370.017715:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553736192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017748:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553736192:12345-0@lo:400:kworker.0 Request processed in 34us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265370.017754:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265370.017771:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553736064 00000100:00100000:1.0:1789265370.017774:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553736064 00000100:00100000:1.0:1789265370.017800:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553735680 00000100:00100000:1.0:1789265370.017803:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553735680 00000100:00100000:1.0:1789265370.017818:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553735808 00000100:00100000:1.0:1789265370.017821:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553735808 00000100:00100000:1.0:1789265370.017845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265370.017852:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553736064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017883:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553736064:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265370.017889:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265370.017909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265370.017915:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553735680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.017943:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553735680:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265370.017949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265370.017960:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265370.017965:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553735808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.018010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553735808:12345-0@lo:400:kworker.0 Request processed in 45us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265370.018016:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789265370.018039:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265370.018044:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265370.018046:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265370.018081:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553736064:0@lo:400:kworker.0 00010000:00080000:1.0:1789265370.018096:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9f100 x1876180553735936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265370.018120:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553735936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.018151:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553735808:0@lo:400:kworker.0 00000100:00100000:1.0:1789265370.018162:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553735680:0@lo:400:kworker.0 00010000:00080000:1.0:1789265370.018171:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9254071ed880 x1876180553736192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265370.018180:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553736192:0@lo:400:kworker.0 00000100:00100000:0.0:1789265370.018499:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553735552:12345-0@lo:400:kworker.0 Request processed in 1574us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265370.018507:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789265370.019287:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553735552:0@lo:400:kworker.0 00000100:00100000:3.0:1789265370.526795:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265370.526820:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553736320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265370.526901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265370.527065:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553736320 00000100:00100000:0.0:1789265370.527074:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553736320 00000100:00100000:0.0:1789265370.527148:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265370.527157:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553736320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265370.527192:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265370.527372:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553736320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265370.527381:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789265370.528827:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185ea00 x1876180553736320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265370.528856:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553736320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265370.655187:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265371.678913:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265371.772408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265371.772455:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265371.772504:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533780864 00000100:00100000:1.0:1789265371.772514:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533780864 00000100:00100000:1.0:1789265371.772563:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 202 00000100:00100000:1.0:1789265371.772572:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:2343:x1876180533780864:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265371.772639:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:2343:x1876180533780864:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265371.772646:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 202 00000100:00100000:0.0:1789265371.772896:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533780992 00000100:00100000:0.0:1789265371.772901:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533780992 00000100:00100000:0.0:1789265371.772960:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:0.0:1789265371.772968:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533780992:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265371.773437:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533780992:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 466us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.773444:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00080000:1.0:1789265371.774714:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265372.574722:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265372.574754:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553736448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265372.574855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265372.574982:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553736448 00000100:00100000:0.0:1789265372.574993:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553736448 00000100:00100000:0.0:1789265372.575094:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265372.575106:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553736448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265372.575154:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265372.575217:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553736448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00080000:1.0:1789265372.575223:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265372.575225:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789265372.575272:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c000 x1876180553736448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265372.575294:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553736448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265372.709645:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265373.731727:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265374.753517:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265375.134964:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265375.135115:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553736704:0@lo:400:kworker.0 00000100:00100000:0.0:1789265375.135143:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265375.135165:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553736960:0@lo:400:kworker.0 00000100:00100000:2.0:1789265375.135230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265375.135239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265375.135318:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265375.135325:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553736832:0@lo:400:kworker.0 00000100:00100000:1.0:1789265375.135399:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553736576:0@lo:400:kworker.0 00000100:00100000:3.0:1789265375.135562:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265375.135573:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553737216:0@lo:400:kworker.0 00000100:00100000:2.0:1789265375.135753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265375.135754:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553737088:0@lo:400:kworker.0 00000100:00100000:0.0:1789265375.135836:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553736960 00000100:00100000:2.0:1789265375.135838:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553736704 00000100:00100000:2.0:1789265375.135847:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553736704 00000100:00100000:0.0:1789265375.135847:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553736960 00000100:00100000:0.0:1789265375.135910:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265375.135912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553736832 00000100:00100000:2.0:1789265375.135918:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553736832 00000100:00100000:0.0:1789265375.135923:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553736960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265375.135947:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789265375.135956:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553736704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265375.136046:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553736960:12345-0@lo:400:kworker.0 Request processed in 126us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265375.136055:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265375.136084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265375.136103:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265375.136111:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265375.136140:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553736576 00000100:00100000:0.0:1789265375.136145:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553736576 00000100:00100000:0.0:1789265375.136234:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789265375.136242:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553736576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265375.136289:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553736576:12345-0@lo:400:kworker.0 Request processed in 48us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265375.136296:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789265375.136388:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265375.136499:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265375.136513:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553736832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265375.136551:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553736832:12345-0@lo:400:kworker.0 Request processed in 45us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265375.136557:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265375.136586:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553737216 00000100:00100000:3.0:1789265375.136590:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553737216 00000100:00100000:3.0:1789265375.136634:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265375.136642:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553737216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265375.136719:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553736576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265375.136841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265375.136910:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553736704:12345-0@lo:400:kworker.0 Request processed in 953us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265375.136918:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789265375.136932:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553737088 00000100:00100000:2.0:1789265375.136936:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553737088 00000100:00100000:2.0:1789265375.136961:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265375.136968:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553737088:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789265375.136988:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9253077f7800 x1876180553736960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265375.137015:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553736960:0@lo:400:kworker.0 00000100:00100000:3.0:1789265375.137036:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553737216:12345-0@lo:400:kworker.0 Request processed in 394us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265375.137044:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789265375.137069:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265375.137073:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265375.137092:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553736832:0@lo:400:kworker.0 00010000:00080000:3.0:1789265375.137098:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9253077f4e00 x1876180553737216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265375.137111:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553737216:0@lo:400:kworker.0 00000100:00100000:0.0:1789265375.137113:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553736704:0@lo:400:kworker.0 00000100:00100000:2.0:1789265375.137189:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553737088:12345-0@lo:400:kworker.0 Request processed in 220us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265375.137196:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265375.137361:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553737088:0@lo:400:kworker.0 00000100:00100000:2.0:1789265375.646550:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265375.646583:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553737344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265375.646685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265375.646891:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553737344 00000100:00100000:2.0:1789265375.646903:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553737344 00000100:00100000:2.0:1789265375.646972:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265375.646984:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553737344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265375.647053:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265375.647121:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553737344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265375.647130:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789265375.647187:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540c33b100 x1876180553737344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265375.647222:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553737344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265375.775460:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265376.800386:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265376.892709:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265376.892763:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265376.892943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533781248 00000100:00100000:3.0:1789265376.892956:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533781248 00000100:00100000:3.0:1789265376.893070:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:3.0:1789265376.893084:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533781248:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265376.893186:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533781248:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 106us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.893194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00080000:1.0:1789265376.893512:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265376.894091:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533781120 00000100:00100000:2.0:1789265376.894101:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533781120 00000100:00100000:2.0:1789265376.894163:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 204 00000100:00100000:2.0:1789265376.894173:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533781120:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265376.894238:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533781120:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 67us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.894246:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 204 00000100:00100000:0.0:1789265377.695943:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265377.695992:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553737472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265377.696218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265377.696325:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553737472 00000100:00100000:0.0:1789265377.696367:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553737472 00000100:00100000:0.0:1789265377.696443:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265377.696454:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553737472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265377.696514:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265377.696572:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553737472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265377.696580:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789265377.696608:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265377.696648:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185fb80 x1876180553737472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265377.697479:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553737472:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265377.824814:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265378.846810:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265379.871146:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265380.254864:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265380.255021:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265380.255043:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553737984:0@lo:400:kworker.0 00000100:00100000:0.0:1789265380.255122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265380.255215:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553737984 00000100:00100000:0.0:1789265380.255224:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553737984 00000100:00100000:0.0:1789265380.255315:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265380.255326:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553737984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265380.255894:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553737728:0@lo:400:kworker.0 00000100:00100000:2.0:1789265380.255949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265380.255980:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265380.255987:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553737856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265380.256010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265380.256043:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553737728 00000100:00100000:2.0:1789265380.256048:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553737728 00000100:00100000:2.0:1789265380.256086:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553737856 00000100:00100000:2.0:1789265380.256089:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553737856 00000100:00100000:2.0:1789265380.256113:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265380.256121:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553737728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265380.256174:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553737728:12345-0@lo:400:kworker.0 Request processed in 54us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265380.256181:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265380.256198:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265380.256205:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553737856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265380.256260:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553737856:12345-0@lo:400:kworker.0 Request processed in 55us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265380.256266:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265380.256314:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553737856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265380.256326:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553737728:0@lo:400:kworker.0 00000100:00080000:2.0:1789265380.256426:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265380.256634:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265380.256847:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553737984:12345-0@lo:400:kworker.0 Request processed in 1522us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265380.256854:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789265380.257193:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437061180 x1876180553737984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265380.257206:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553737984:0@lo:400:kworker.0 00000100:00100000:1.0:1789265380.257374:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553737600:0@lo:400:kworker.0 00000100:00100000:1.0:1789265380.257418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265380.257660:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265380.257679:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553738112:0@lo:400:kworker.0 00000100:00100000:1.0:1789265380.257709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265380.257754:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553738240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265380.257780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265380.257817:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553738240 00000100:00100000:1.0:1789265380.257823:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553738240 00000100:00100000:1.0:1789265380.257873:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265380.257882:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553738240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265380.257936:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553738240:12345-0@lo:400:kworker.0 Request processed in 56us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265380.257944:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265380.257966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553738112 00000100:00100000:1.0:1789265380.257970:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553738112 00000100:00100000:1.0:1789265380.257998:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265380.258005:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553738112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265380.258038:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553738112:12345-0@lo:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265380.258045:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789265380.258074:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437062a00 x1876180553738240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265380.258084:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553738240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265380.258125:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553738112:0@lo:400:kworker.0 00000100:00080000:1.0:1789265380.258150:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265380.258154:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265380.260552:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553737600 00000100:00100000:2.0:1789265380.260569:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553737600 00000100:00100000:2.0:1789265380.260869:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789265380.260881:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553737600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265380.262169:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553737600:12345-0@lo:400:kworker.0 Request processed in 1284us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265380.262181:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789265380.263004:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553737600:0@lo:400:kworker.0 00000100:00100000:3.0:1789265380.767072:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265380.767101:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553738368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265380.767183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265380.767370:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553738368 00000100:00100000:0.0:1789265380.767379:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553738368 00000100:00100000:0.0:1789265380.767442:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265380.767454:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553738368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265380.767496:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265380.767560:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553738368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265380.767567:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789265380.767658:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540c33a680 x1876180553738368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265380.767679:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553738368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265380.894622:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265381.920259:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265382.012917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.012974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265382.013133:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533781376 00000100:00100000:3.0:1789265382.013147:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533781376 00000100:00100000:3.0:1789265382.013219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 206 00000100:00100000:3.0:1789265382.013231:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:2345:x1876180533781376:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265382.013356:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+10:2345:x1876180533781376:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 126us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265382.013365:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 206 00000100:00100000:2.0:1789265382.014226:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533781504 00000100:00100000:2.0:1789265382.014235:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533781504 00000100:00100000:2.0:1789265382.014520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:2.0:1789265382.014530:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533781504:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265382.014592:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533781504:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 65us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265382.014600:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00080000:1.0:1789265382.015029:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789265382.311244:0:10102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:09:40 (1789265380) === 00000100:00100000:3.0:1789265382.764607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265382.764980:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533781632 00000100:00100000:2.0:1789265382.764997:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533781632 00000100:00100000:2.0:1789265382.765079:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 207 00000100:00100000:2.0:1789265382.765093:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+10:8120:x1876180533781632:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265382.765118:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265382.765146:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136a00/0x8e12577ef818f4d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8347 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265382.765188:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136a00/0x8e12577ef818f4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8347 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265382.765201:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136a00/0x8e12577ef818f4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8347 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265382.765211:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136a00, rc 0) 00000100:00100000:2.0:1789265382.765588:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:8120:x1876180533781632:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 495us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265382.765596:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 207 00000100:00100000:0.0:1789265382.776241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.776518:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533781760 00000100:00100000:1.0:1789265382.776533:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533781760 00000100:00100000:1.0:1789265382.776663:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 208 00000100:00100000:1.0:1789265382.776676:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+11:8120:x1876180533781760:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265382.777518:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+11:8120:x1876180533781760:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 839us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.777530:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 208 00000100:00100000:2.0:1789265382.782609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265382.782891:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533781888 00000100:00100000:0.0:1789265382.782908:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533781888 00000100:00100000:0.0:1789265382.782979:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 209 00000100:00100000:0.0:1789265382.782992:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:8120:x1876180533781888:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789265382.783383:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:8120:x1876180533781888:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 392us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.783393:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 209 00000100:00100000:2.0:1789265382.789310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265382.792813:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533782016 00000100:00100000:0.0:1789265382.792836:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533782016 00000100:00100000:0.0:1789265382.793027:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 210 00000100:00100000:0.0:1789265382.793041:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:8124:x1876180533782016:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265382.793940:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:8124:x1876180533782016:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 892us (4653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.793954:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 210 00000100:00100000:2.0:1789265382.811328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.811613:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533782144 00000100:00100000:1.0:1789265382.811628:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533782144 00000100:00100000:1.0:1789265382.811701:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 211 00000100:00100000:1.0:1789265382.811713:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+11:8124:x1876180533782144:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265382.812107:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+11:8124:x1876180533782144:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 394us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.812121:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 211 00000100:00100000:2.0:1789265382.814613:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265382.814647:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553738496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265382.814914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265382.816309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.816437:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533782272 00000100:00100000:1.0:1789265382.816451:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533782272 00000100:00100000:1.0:1789265382.816535:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 212 00000100:00100000:1.0:1789265382.816547:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:8120:x1876180533782272:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265382.816572:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265382.816596:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207c600/0x8e12577ef818f4d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8371 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265382.816648:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207c600/0x8e12577ef818f4d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8371 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265382.816662:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207c600/0x8e12577ef818f4d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8371 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265382.816673:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207c600, rc 0) 00000100:00100000:1.0:1789265382.816902:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+12:8120:x1876180533782272:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 356us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.816911:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 212 00000100:00100000:2.0:1789265382.821704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.822040:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533782400 00000100:00100000:1.0:1789265382.822055:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533782400 00000100:00100000:1.0:1789265382.822145:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 213 00000100:00100000:1.0:1789265382.822159:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+12:8120:x1876180533782400:12345-192.168.204.43@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789265382.822202:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789265382.822237:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789265382.822242:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789265382.822245:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789265382.822247:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789265382.822830:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553738496 00000100:00100000:0.0:1789265382.822837:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553738496 00000100:00100000:0.0:1789265382.822911:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265382.822921:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553738496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265382.822962:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265382.823060:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553738496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (8146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.823068:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789265382.823131:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c700 x1876180553738496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265382.823156:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553738496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265382.823408:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265382.825440:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+12:8120:x1876180533782400:12345-192.168.204.43@tcp:256:mount.lustre.0 Request processed in 3265us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.825476:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 213 00000100:00100000:2.0:1789265382.830753:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.831142:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533782528 00000100:00100000:1.0:1789265382.831160:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533782528 00000100:00100000:1.0:1789265382.831241:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 214 00000100:00100000:1.0:1789265382.831256:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+12:8120:x1876180533782528:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265382.831281:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265382.831308:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8378 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265382.831501:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265382.831518:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265382.831531:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92544207d400, rc 0) 00000100:00100000:1.0:1789265382.831926:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:8120:x1876180533782528:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 669us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.831936:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 214 00000100:00100000:2.0:1789265382.834107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.834221:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533782656 00000100:00100000:1.0:1789265382.834234:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533782656 00000100:00100000:1.0:1789265382.834319:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 215 00000100:00100000:1.0:1789265382.834370:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:8120:x1876180533782656:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265382.834823:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:8120:x1876180533782656:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 490us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.834833:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 215 00000100:00100000:2.0:1789265382.836646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.836872:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533782784 00000100:00100000:1.0:1789265382.836884:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533782784 00000100:00100000:1.0:1789265382.836953:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 216 00000100:00100000:1.0:1789265382.836965:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:8120:x1876180533782784:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789265382.837313:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:8120:x1876180533782784:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 348us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.837322:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 216 00000100:00100000:2.0:1789265382.842624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265382.842835:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533782912 00000100:00100000:3.0:1789265382.842849:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533782912 00000100:00100000:3.0:1789265382.843221:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 217 00000100:00100000:3.0:1789265382.843235:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:8127:x1876180533782912:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265382.843608:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:8127:x1876180533782912:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 376us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265382.843618:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 217 00000100:00100000:2.0:1789265382.847800:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.848013:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533783040 00000100:00100000:1.0:1789265382.848027:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533783040 00000100:00100000:1.0:1789265382.848112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 218 00000100:00100000:1.0:1789265382.848125:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:8127:x1876180533783040:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265382.848929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:8127:x1876180533783040:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 798us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.848943:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 218 00000100:00100000:2.0:1789265382.856895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265382.857178:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533783168 00000100:00100000:3.0:1789265382.857193:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533783168 00000100:00100000:3.0:1789265382.857324:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:3.0:1789265382.857381:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2341:x1876180533783168:12345-192.168.204.43@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789265382.857423:0:9387:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cc11c6fc-2632-4cbd-ac58-de8d52cda298@192.168.204.43@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1789265382.857472:0:9387:0:(genops.c:1385:class_connect()) connect: client cc11c6fc-2632-4cbd-ac58-de8d52cda298, cookie 0x8e12577ef818f4e5 00000004:00100000:3.0:1789265382.857513:0:9387:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789265382.857897:0:9387:0:(import.c:65:import_set_state_nolock()) ffff925403512000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265382.857998:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2341:x1876180533783168:12345-192.168.204.43@tcp:38:mount.lustre.0 Request processed in 618us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265382.858008:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:2.0:1789265382.865276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265382.865409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265382.866998:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533783296 00000100:00100000:3.0:1789265382.867018:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533783296 00000100:00100000:3.0:1789265382.867132:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533783424 00000100:00100000:3.0:1789265382.867157:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533783424 00000100:00100000:3.0:1789265382.867191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:3.0:1789265382.867205:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+7:0:x1876180533783296:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265382.867269:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789265382.867422:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+7:0:x1876180533783296:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 221us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265382.867431:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:3.0:1789265382.867453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:3.0:1789265382.867461:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:8120:x1876180533783424:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265382.867473:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789265382.867496:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:8120:x1876180533783424:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 36us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265382.867502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00080000:2.0:1789265382.870694:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265382.874847:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265382.874956:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533783552 00000100:00100000:3.0:1789265382.874971:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533783552 00000100:00100000:3.0:1789265382.875053:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:3.0:1789265382.875067:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:8120:x1876180533783552:12345-192.168.204.43@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789265382.875195:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:8120:x1876180533783552:12345-192.168.204.43@tcp:40:mount.lustre.0 Request processed in 132us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265382.875204:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:2.0:1789265382.880696:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.880840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533783936 00000100:00100000:1.0:1789265382.880864:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533783936 00000100:00100000:1.0:1789265382.880947:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:1.0:1789265382.880960:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:8120:x1876180533783936:12345-192.168.204.43@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789265382.881075:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789265382.883565:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:8120:x1876180533783936:12345-192.168.204.43@tcp:33:mount.lustre.0 Request processed in 2587us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.883590:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:2.0:1789265382.884142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265382.884525:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533783680 00000100:00100000:0.0:1789265382.884540:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533783680 00000100:00100000:0.0:1789265382.884600:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:0.0:1789265382.884610:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876180533783680:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789265382.884653:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cc11c6fc-2632-4cbd-ac58-de8d52cda298@192.168.204.43@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1789265382.884732:0:6680:0:(genops.c:1385:class_connect()) connect: client cc11c6fc-2632-4cbd-ac58-de8d52cda298, cookie 0x8e12577ef818f4ec 00002000:00100000:0.0:1789265382.884749:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cc11c6fc-2632-4cbd-ac58-de8d52cda298/ffff92540c27c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265382.884763:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789265382.885106:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789265382.885153:0:6680:0:(import.c:65:import_set_state_nolock()) ffff92540c27a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265382.885232:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2341:x1876180533783680:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 620us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.885241:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1789265382.886037:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265382.888407:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533783808 00000100:00100000:1.0:1789265382.888432:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533783808 00000100:00100000:1.0:1789265382.888517:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1789265382.888528:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876180533783808:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789265382.888576:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cc11c6fc-2632-4cbd-ac58-de8d52cda298@192.168.204.43@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1789265382.888621:0:6681:0:(genops.c:1385:class_connect()) connect: client cc11c6fc-2632-4cbd-ac58-de8d52cda298, cookie 0x8e12577ef818f4f3 00002000:00100000:1.0:1789265382.888657:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cc11c6fc-2632-4cbd-ac58-de8d52cda298/ffff9254377ed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789265382.888710:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789265382.889391:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789265382.889446:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92540c278000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265382.889578:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2341:x1876180533783808:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 1049us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.889589:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00010000:00010000:2.0:1789265382.943437:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265383.968905:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265385.003371:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265385.375985:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553738624:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265385.376158:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553739136:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265385.376223:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265385.376230:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553739008:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265385.376293:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553738752:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265385.376362:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553739264:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265385.376419:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265385.376425:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553738880:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265385.376575:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553739136 00000100:00100000:2.0:1789265385.376587:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553739136 00000100:00100000:2.0:1789265385.376650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553738752 00000100:00100000:2.0:1789265385.376654:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553738752 00000100:00100000:2.0:1789265385.376670:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553738880 00000100:00100000:2.0:1789265385.376672:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553738880 00000100:00100000:2.0:1789265385.376689:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265385.376698:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553739136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376766:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553739136:12345-0@lo:400:kworker.0 Request processed in 68us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265385.376774:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265385.376793:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265385.376800:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553738752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376849:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553738752:12345-0@lo:400:kworker.0 Request processed in 49us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265385.376857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265385.376872:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265385.376881:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553738880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.376911:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553738880:12345-0@lo:400:kworker.0 Request processed in 33us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265385.376917:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265385.376938:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553739008 00000100:00100000:2.0:1789265385.376942:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553739008 00000100:00100000:2.0:1789265385.376989:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553739264 00000100:00100000:2.0:1789265385.376993:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553739264 00000100:00100000:2.0:1789265385.377021:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265385.377027:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553739008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.377063:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553739008:12345-0@lo:400:kworker.0 Request processed in 36us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265385.377069:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265385.377080:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265385.377085:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553739264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.377111:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553739264:12345-0@lo:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265385.377118:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789265385.377142:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265385.377147:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265385.377150:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265385.377195:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553738880:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.377208:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553738752:0@lo:400:kworker.0 00010000:00080000:2.0:1789265385.377221:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437063b80 x1876180553739264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265385.377231:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553739264:0@lo:400:kworker.0 00010000:00080000:2.0:1789265385.377283:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437062300 x1876180553739008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265385.377292:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553739008:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.377305:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553739136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265385.377761:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553738624 00000100:00100000:3.0:1789265385.377767:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553738624 00000100:00100000:3.0:1789265385.377830:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789265385.377840:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553738624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265385.377962:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553738624:12345-0@lo:400:kworker.0 Request processed in 123us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265385.377976:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789265385.378033:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553738624:0@lo:400:kworker.0 00000100:00100000:2.0:1789265385.886717:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553739392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265385.886893:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265385.887122:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553739392 00000100:00100000:0.0:1789265385.887131:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553739392 00000100:00100000:0.0:1789265385.887252:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265385.887262:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553739392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265385.887305:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265385.887387:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553739392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265385.887395:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789265385.887553:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c700 x1876180553739392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265385.887575:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553739392:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1789265385.939518:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc11c6fc-2632-4cbd-ac58-de8d52cda298 00010000:00010000:1.0:1789265386.015692:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789265386.449657:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc11c6fc-2632-4cbd-ac58-de8d52cda298 00000001:00100000:0.0:1789265386.975845:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc11c6fc-2632-4cbd-ac58-de8d52cda298 00010000:00010000:1.0:1789265387.038752:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265387.936920:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265387.936946:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553739520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265387.937054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265387.937449:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553739520 00000100:00100000:0.0:1789265387.937459:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553739520 00000100:00100000:0.0:1789265387.937547:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265387.937558:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553739520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265387.937616:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265387.937891:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553739520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 333us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265387.937900:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789265387.938242:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265387.938257:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185c700 x1876180553739520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265387.938282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553739520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265388.062636:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265388.153488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265388.153614:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265388.153654:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265388.153688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265388.153726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265388.153773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533784320 00000100:00100000:1.0:1789265388.153785:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533784320 00000100:00100000:1.0:1789265388.153848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533784192 00000100:00100000:1.0:1789265388.153852:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533784192 00000100:00100000:1.0:1789265388.153879:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:1.0:1789265388.153889:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533784320:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265388.153983:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533784320:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 95us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265388.153991:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:1.0:1789265388.154026:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:1.0:1789265388.154033:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533784192:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265388.154059:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533784192:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265388.154084:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:1.0:1789265388.154135:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533784576 00000100:00100000:1.0:1789265388.154140:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533784576 00000100:00100000:1.0:1789265388.154168:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533784448 00000100:00100000:1.0:1789265388.154171:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533784448 00000100:00100000:1.0:1789265388.154193:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:1.0:1789265388.154200:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533784576:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265388.154229:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533784576:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265388.154236:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:1.0:1789265388.154247:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:1.0:1789265388.154254:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533784448:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265388.154280:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533784448:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 27us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265388.154286:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00080000:3.0:1789265388.154611:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265388.154615:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265388.154618:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265388.157202:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533784064 00000100:00100000:2.0:1789265388.157220:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533784064 00000100:00100000:2.0:1789265388.157416:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 220 00000100:00100000:2.0:1789265388.157427:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533784064:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265388.157522:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533784064:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 97us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265388.157530:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 220 00010000:00010000:1.0:1789265389.091511:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265389.181229:0:10300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789265390.110987:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265390.495162:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553740032:0@lo:400:kworker.0 00000100:00100000:1.0:1789265390.495261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265390.495328:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789265390.495393:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553739776:0@lo:400:kworker.0 00000100:00100000:2.0:1789265390.495450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265390.495491:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553740288:0@lo:400:kworker.0 00000100:00100000:2.0:1789265390.495530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265390.495557:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265390.495563:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553739904:0@lo:400:kworker.0 00000100:00100000:2.0:1789265390.495598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265390.495645:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553739776 00000100:00100000:2.0:1789265390.495656:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553739776 00000100:00100000:2.0:1789265390.495721:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553739904 00000100:00100000:2.0:1789265390.495725:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553739904 00000100:00100000:2.0:1789265390.495760:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265390.495769:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553739776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265390.495845:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553739776:12345-0@lo:400:kworker.0 Request processed in 77us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265390.495854:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265390.495874:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265390.495881:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553739904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265390.495908:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553739904:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265390.495914:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265390.495948:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553740032 00000100:00100000:2.0:1789265390.495952:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553740032 00000100:00100000:2.0:1789265390.495979:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553740288 00000100:00100000:2.0:1789265390.495982:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553740288 00000100:00100000:2.0:1789265390.496078:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265390.496086:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553740032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265390.496118:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553740032:12345-0@lo:400:kworker.0 Request processed in 33us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265390.496124:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265390.496135:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265390.496140:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553740288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265390.496166:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553740288:12345-0@lo:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265390.496173:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789265390.496201:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265390.496205:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265390.496207:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265390.496253:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553739904:0@lo:400:kworker.0 00000100:00100000:2.0:1789265390.496273:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553739776:0@lo:400:kworker.0 00010000:00080000:2.0:1789265390.496287:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437501f80 x1876180553740288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265390.496298:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553740288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265390.498892:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553739648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265390.499113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265390.499181:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553740160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265390.499215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789265390.499263:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437500a80 x1876180553740032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265390.499287:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553740032:0@lo:400:kworker.0 00000100:00100000:1.0:1789265390.499369:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553739648 00000100:00100000:1.0:1789265390.499378:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553739648 00000100:00100000:1.0:1789265390.499433:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789265390.499443:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265390.499501:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553739648:12345-0@lo:400:kworker.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265390.499509:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789265390.499549:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553740160 00000100:00100000:1.0:1789265390.499552:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553740160 00000100:00100000:1.0:1789265390.500073:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789265390.500084:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553740160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265390.500129:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553740160:12345-0@lo:400:kworker.0 Request processed in 49us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265390.500136:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1789265390.500162:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265390.500204:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553739648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265390.500217:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553740160:0@lo:400:kworker.0 00000100:00100000:0.0:1789265391.007651:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553740416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265391.007756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265391.007850:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553740416 00000100:00100000:0.0:1789265391.007859:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553740416 00000100:00100000:0.0:1789265391.007911:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265391.007921:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553740416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265391.007964:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265391.008009:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553740416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265391.008017:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789265391.008064:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185ea00 x1876180553740416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265391.008084:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553740416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265391.135256:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265392.159727:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265393.056362:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553740544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265393.056442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265393.060165:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553740544 00000100:00100000:0.0:1789265393.060182:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553740544 00000100:00100000:1.0:1789265393.060389:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265393.060401:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553740544:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265393.060603:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789265393.060807:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265393.060906:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553740544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 508us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265393.060914:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789265393.061152:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185ea00 x1876180553740544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265393.061174:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553740544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265393.184727:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265393.274044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265393.274133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265393.274152:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533784832 00000100:00100000:2.0:1789265393.274172:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533784832 00000100:00100000:1.0:1789265393.274213:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533785088 00000100:00100000:1.0:1789265393.274220:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533785088 00000100:00100000:2.0:1789265393.274279:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:2.0:1789265393.274290:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533784832:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:3.0:1789265393.274405:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265393.274410:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265393.276505:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:1.0:1789265393.276532:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533785088:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265393.277924:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533784832:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 3626us (3898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265393.277938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:1.0:1789265393.282857:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533785088:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 6325us (8710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265393.282873:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1789265393.290587:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265393.290690:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265393.290781:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533784960 00000100:00100000:2.0:1789265393.290793:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533784960 00000100:00100000:2.0:1789265393.290887:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:2.0:1789265393.290897:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533784960:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265393.290982:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533784960:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265393.290990:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:0.0:1789265393.291275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00080000:3.0:1789265393.291519:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265393.291755:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533785216 00000100:00100000:2.0:1789265393.291762:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533785216 00000100:00100000:2.0:1789265393.291827:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:2.0:1789265393.291836:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533785216:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265393.291885:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533785216:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 50us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265393.291893:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00080000:3.0:1789265393.295103:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265393.295828:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533784704 00000100:00100000:1.0:1789265393.295841:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533784704 00000100:00100000:1.0:1789265393.295991:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 222 00000100:00100000:1.0:1789265393.296003:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533784704:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265393.296134:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533784704:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 132us (5567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265393.296143:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 222 00010000:00010000:2.0:1789265394.206758:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265395.230539:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265395.616312:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553740800:0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.616403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265395.616456:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553741312:0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.616482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265395.616547:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265395.616554:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553740928:0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.616578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265395.616623:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553741312 00000100:00100000:3.0:1789265395.616630:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553741312 00000100:00100000:3.0:1789265395.616683:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265395.616704:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553741312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.616770:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553741312:12345-0@lo:400:kworker.0 Request processed in 79us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265395.616777:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265395.616803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553740800 00000100:00100000:3.0:1789265395.616806:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553740800 00000100:00100000:3.0:1789265395.616832:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553740928 00000100:00100000:3.0:1789265395.616835:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553740928 00000100:00100000:3.0:1789265395.616856:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265395.616863:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553740800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.616896:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553740800:12345-0@lo:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265395.616902:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265395.616913:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265395.616919:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553740928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.616945:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553740928:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265395.616952:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789265395.616969:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265395.616974:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265395.617001:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553740928:0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.617012:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553740800:0@lo:400:kworker.0 00010000:00080000:3.0:1789265395.617026:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437061f80 x1876180553741312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265395.617036:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553741312:0@lo:400:kworker.0 00000100:00100000:1.0:1789265395.617393:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553740672:0@lo:400:kworker.0 00000100:00100000:1.0:1789265395.617433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265395.617466:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553741184:0@lo:400:kworker.0 00000100:00100000:1.0:1789265395.617503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265395.617526:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265395.617532:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553741056:0@lo:400:kworker.0 00000100:00100000:1.0:1789265395.617570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265395.617617:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553741184 00000100:00100000:1.0:1789265395.617623:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553741184 00000100:00100000:1.0:1789265395.617658:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265395.617665:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553741184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.617922:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553740672 00000100:00100000:3.0:1789265395.617933:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553740672 00000100:00100000:3.0:1789265395.617962:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789265395.617968:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553740672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265395.618695:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553740672:12345-0@lo:400:kworker.0 Request processed in 725us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265395.618703:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789265395.619308:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553741056 00000100:00100000:0.0:1789265395.619322:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553741056 00000100:00100000:0.0:1789265395.619393:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265395.619401:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437559050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553741056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265395.619450:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437559050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553741056:12345-0@lo:400:kworker.0 Request processed in 50us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265395.619456:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789265395.619649:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265395.619653:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789265395.619702:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437060a80 x1876180553741056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265395.619716:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553741056:0@lo:400:kworker.0 00000100:00100000:0.0:1789265395.619728:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553740672:0@lo:400:kworker.0 00000100:00100000:1.0:1789265395.621931:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553741184:12345-0@lo:400:kworker.0 Request processed in 4255us (4416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265395.621947:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265395.626516:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553741184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265396.129847:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553741440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265396.129940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265396.130006:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553741440 00000100:00100000:1.0:1789265396.130017:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553741440 00000100:00100000:1.0:1789265396.130100:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265396.130113:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553741440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265396.130215:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265396.130891:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553741440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 776us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265396.130900:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789265396.130949:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3e8380 x1876180553741440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265396.130970:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553741440:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265396.255063:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265397.278635:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265398.175540:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553741568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265398.175633:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265398.175854:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553741568 00000100:00100000:2.0:1789265398.175863:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553741568 00000100:00100000:2.0:1789265398.175931:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265398.175942:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553741568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265398.176010:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265398.176064:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553741568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265398.176072:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789265398.176129:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265398.176160:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3eb480 x1876180553741568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265398.176180:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553741568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265398.303682:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265398.395385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265398.395438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265398.395475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265398.395494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265398.395521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265398.395566:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533785728 00000100:00100000:0.0:1789265398.395576:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533785728 00000100:00100000:0.0:1789265398.395649:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533785856 00000100:00100000:0.0:1789265398.395654:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533785856 00000100:00100000:0.0:1789265398.395681:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1789265398.395691:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533785728:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265398.395787:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533785728:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 97us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265398.395807:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1789265398.395823:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:0.0:1789265398.395830:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533785856:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265398.395858:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533785856:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265398.395864:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:0.0:1789265398.395882:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533785344 00000100:00100000:0.0:1789265398.395886:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533785344 00000100:00100000:0.0:1789265398.395912:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 224 00000100:00100000:0.0:1789265398.395919:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533785344:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265398.395950:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533785344:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265398.395956:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 224 00000100:00100000:0.0:1789265398.395985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533785472 00000100:00100000:0.0:1789265398.395988:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533785472 00000100:00100000:1.0:1789265398.395990:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533785600 00000100:00100000:1.0:1789265398.395993:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533785600 00000100:00100000:1.0:1789265398.396025:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:1.0:1789265398.396031:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533785600:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265398.396065:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533785600:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265398.396071:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:1.0:1789265398.396092:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:1.0:1789265398.396099:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533785472:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265398.396127:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533785472:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 29us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265398.396133:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00080000:0.0:1789265398.398029:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265398.398037:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265398.398039:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265399.327763:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265400.352285:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265400.734608:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553741696:0@lo:400:kworker.0 00000100:00100000:1.0:1789265400.734692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265400.734810:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553741696 00000100:00100000:0.0:1789265400.734820:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553741696 00000100:00100000:0.0:1789265400.734872:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789265400.734881:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553741696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265400.734941:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553741696:12345-0@lo:400:kworker.0 Request processed in 60us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265400.734948:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789265400.735015:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553741696:0@lo:400:kworker.0 00000100:00100000:3.0:1789265400.735124:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553741824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265400.735140:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553742080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265400.735159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265400.735168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265400.735187:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265400.735192:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553742208:0@lo:400:kworker.0 00000100:00100000:2.0:1789265400.735211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265400.735238:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553742336:0@lo:400:kworker.0 00000100:00100000:3.0:1789265400.735263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265400.735270:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553741952:0@lo:400:kworker.0 00000100:00100000:0.0:1789265400.735296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265400.735320:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553741824 00000100:00100000:0.0:1789265400.735324:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553742208 00000100:00100000:3.0:1789265400.735325:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553741824 00000100:00100000:0.0:1789265400.735327:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553742208 00000100:00100000:3.0:1789265400.735375:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553741952 00000100:00100000:3.0:1789265400.735378:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553741952 00000100:00100000:3.0:1789265400.735408:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265400.735415:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553741824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265400.735451:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553741824:12345-0@lo:400:kworker.0 Request processed in 37us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265400.735458:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265400.735472:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265400.735486:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553741952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265400.735541:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553741952:12345-0@lo:400:kworker.0 Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265400.735547:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265400.735560:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789265400.735566:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553742208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265400.735595:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553742208:12345-0@lo:400:kworker.0 Request processed in 29us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265400.735601:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265400.735618:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553741952:0@lo:400:kworker.0 00000100:00100000:2.0:1789265400.735655:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553742080 00000100:00100000:2.0:1789265400.735659:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553742080 00000100:00100000:2.0:1789265400.735695:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553742336 00000100:00100000:2.0:1789265400.735704:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553742336 00000100:00100000:2.0:1789265400.735732:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265400.735738:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553742080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265400.735770:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553742080:12345-0@lo:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265400.735770:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265400.735776:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265400.735778:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553742336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265400.735803:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553742208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265400.735808:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553742336:12345-0@lo:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00010000:00080000:2.0:1789265400.735813:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3e8000 x1876180553742080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265400.735814:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265400.735823:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553742080:0@lo:400:kworker.0 00000100:00080000:0.0:1789265400.736711:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265400.736719:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265400.736722:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789265400.737013:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3eb100 x1876180553742336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265400.737028:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553742336:0@lo:400:kworker.0 00000100:00100000:3.0:1789265400.737040:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553741824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265401.251078:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265401.251107:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553742464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265401.251194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265401.251267:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553742464 00000100:00100000:2.0:1789265401.251275:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553742464 00000100:00100000:2.0:1789265401.252792:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265401.252814:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553742464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265401.252856:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265401.252942:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553742464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265401.252950:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789265401.253857:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437061c00 x1876180553742464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265401.253884:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553742464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265401.375573:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265402.399444:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265403.294527:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265403.294559:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553742592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265403.294632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265403.295518:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553742592 00000100:00100000:2.0:1789265403.295530:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553742592 00000100:00100000:2.0:1789265403.295603:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265403.295614:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553742592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265403.295650:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265403.295714:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553742592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265403.295721:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789265403.296169:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265403.296231:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3e9180 x1876180553742592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265403.296254:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553742592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265403.422575:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265403.518587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265403.518634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265403.518676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265403.518728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265403.518749:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533786368 00000100:00100000:2.0:1789265403.518759:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533786368 00000100:00100000:0.0:1789265403.518831:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533785984 00000100:00100000:0.0:1789265403.518835:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533785984 00000100:00100000:2.0:1789265403.518842:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:2.0:1789265403.518851:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2341:x1876180533786368:12345-192.168.204.43@tcp:9:kworker.0 00000100:00100000:0.0:1789265403.518861:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 226 00000100:00100000:0.0:1789265403.518867:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533785984:12345-192.168.204.43@tcp:400:kworker.0 00000020:00000080:2.0:1789265403.518880:0:9090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f4ec 00000100:00080000:2.0:1789265403.518887:0:9090:0:(import.c:65:import_set_state_nolock()) ffff92540c27a800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789265403.518922:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533785984:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 54us (345us total) trans 0 rc 0/0 00000001:00000004:2.0:1789265403.518924:0:9090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789265403.518929:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 226 00000100:00100000:0.0:1789265403.518961:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533786112 00000100:00100000:0.0:1789265403.518964:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533786112 00000100:00100000:0.0:1789265403.518987:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533786240 00000100:00100000:0.0:1789265403.518990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533786240 00000100:00100000:0.0:1789265403.519027:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:0.0:1789265403.519034:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533786112:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:3.0:1789265403.519058:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265403.519064:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533786112:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00080000:3.0:1789265403.519066:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265403.519070:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:0.0:1789265403.519081:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:0.0:1789265403.519088:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533786240:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265403.519111:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533786240:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265403.519116:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:2.0:1789265403.521271:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc11c6fc-2632-4cbd-ac58-de8d52cda298+2:2341:x1876180533786368:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 2407us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265403.521284:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00010000:00010000:2.0:1789265403.521322:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265403.523772:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265403.523892:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533786496 00000100:00100000:1.0:1789265403.523902:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533786496 00000100:00100000:1.0:1789265403.523985:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:1.0:1789265403.523995:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2341:x1876180533786496:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:1.0:1789265403.524036:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f4f3 00000100:00080000:1.0:1789265403.524046:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92540c278000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265403.524099:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1789265403.524149:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265403.524518:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+2:2341:x1876180533786496:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 522us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265403.524526:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00080000:3.0:1789265403.524783:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789265404.446656:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265405.470724:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265405.633035:0:10999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789265405.858180:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265405.858210:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553743104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265405.858221:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553742848:0@lo:400:kworker.0 00000100:00100000:0.0:1789265405.858439:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553743232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265405.861672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265405.862013:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265405.862052:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553742720:0@lo:400:kworker.0 00000100:00100000:2.0:1789265405.862088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265405.862132:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553742720 00000100:00100000:2.0:1789265405.862155:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553742720 00000100:00100000:2.0:1789265405.862201:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789265405.862210:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553742720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265405.862259:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553742720:12345-0@lo:400:kworker.0 Request processed in 49us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265405.862265:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789265405.862310:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553742720:0@lo:400:kworker.0 00000100:00100000:1.0:1789265405.862433:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553743104 00000100:00100000:1.0:1789265405.862443:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553743104 00000100:00100000:1.0:1789265405.862495:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265405.862502:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553743104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265405.862537:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553743104:12345-0@lo:400:kworker.0 Request processed in 37us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265405.862543:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789265405.862677:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265405.862705:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437063480 x1876180553743104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265405.862717:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553743104:0@lo:400:kworker.0 00000100:00100000:1.0:1789265405.863422:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553742976:0@lo:400:kworker.0 00000100:00100000:1.0:1789265405.863479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265405.863572:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553743232 00000100:00100000:2.0:1789265405.863577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553743232 00000100:00100000:2.0:1789265405.863624:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553742976 00000100:00100000:2.0:1789265405.863627:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553742976 00000100:00100000:2.0:1789265405.863646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789265405.863653:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553743232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265405.863697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553743232:12345-0@lo:400:kworker.0 Request processed in 45us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265405.863703:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789265405.863716:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789265405.863721:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553742976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265405.863745:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553742976:12345-0@lo:400:kworker.0 Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265405.863750:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789265405.863927:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265405.863954:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553742976:0@lo:400:kworker.0 00000100:00100000:1.0:1789265405.863981:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553743232:0@lo:400:kworker.0 00000100:00100000:2.0:1789265405.872586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265405.872668:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553743360:0@lo:400:kworker.0 00000100:00100000:2.0:1789265405.872734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265405.873187:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553742848 00000100:00100000:1.0:1789265405.873196:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553742848 00000100:00100000:1.0:1789265405.873253:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789265405.873262:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553742848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265405.873357:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553742848:12345-0@lo:400:kworker.0 Request processed in 96us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265405.873366:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265405.873417:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553742848:0@lo:400:kworker.0 00000100:00100000:0.0:1789265405.873639:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553743360 00000100:00100000:0.0:1789265405.873644:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553743360 00000100:00100000:0.0:1789265405.873707:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265405.873717:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553743360:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789265405.873766:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265405.873767:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553743360:12345-0@lo:400:kworker.0 Request processed in 52us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265405.873777:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1789265405.874086:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437060a80 x1876180553743360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265405.874114:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553743360:0@lo:400:kworker.0 00000100:00100000:1.0:1789265406.369217:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553743488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265406.369313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265406.369604:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553743488 00000100:00100000:2.0:1789265406.369612:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553743488 00000100:00100000:2.0:1789265406.369664:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265406.369675:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553743488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265406.369710:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265406.369771:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553743488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265406.369778:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789265406.370021:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437060a80 x1876180553743488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265406.370042:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553743488:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265406.494726:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265406.982845:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc11c6fc-2632-4cbd-ac58-de8d52cda298 00000020:00000080:0.0:1789265406.982860:0:6704:0:(genops.c:885:class_export_put()) final put ffff92540c27c000/cc11c6fc-2632-4cbd-ac58-de8d52cda298 00000020:00000080:0.0:1789265406.982896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92540c27c000/cc11c6fc-2632-4cbd-ac58-de8d52cda298 for lustre-OST0000 00000020:00000080:0.0:1789265406.982955:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92540c27a800 for lustre-OST0000 00000001:00100000:2.0:1789265407.446578:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc11c6fc-2632-4cbd-ac58-de8d52cda298 00000020:00000080:2.0:1789265407.446590:0:7630:0:(genops.c:885:class_export_put()) final put ffff9254377ed000/cc11c6fc-2632-4cbd-ac58-de8d52cda298 00000020:00000080:0.0:1789265407.446666:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9254377ed000/cc11c6fc-2632-4cbd-ac58-de8d52cda298 for lustre-OST0001 00000020:00000080:0.0:1789265407.446758:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92540c278000 for lustre-OST0001 00010000:00010000:0.0:1789265407.519705:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265408.415477:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265408.415500:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553743616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265408.415586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265408.415667:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553743616 00000100:00100000:2.0:1789265408.415675:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553743616 00000100:00100000:2.0:1789265408.415736:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265408.415746:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553743616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265408.415784:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265408.415828:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553743616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265408.415835:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789265408.415858:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265408.415891:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3ea300 x1876180553743616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265408.415921:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553743616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265408.551546:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265408.630313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265408.630394:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265408.630426:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533786752 00000100:00100000:2.0:1789265408.630438:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533786752 00000100:00100000:2.0:1789265408.630507:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:2.0:1789265408.630519:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533786752:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265408.630609:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533786752:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 93us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265408.630616:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00080000:2.0:1789265408.630641:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265408.631968:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533786624 00000100:00100000:3.0:1789265408.631979:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533786624 00000100:00100000:3.0:1789265408.632952:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 228 00000100:00100000:3.0:1789265408.632967:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533786624:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265408.633049:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533786624:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 86us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265408.633057:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 228 00000100:00100000:0.0:1789265408.633279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265408.634207:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533786880 00000100:00100000:3.0:1789265408.634217:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533786880 00000100:00100000:3.0:1789265408.634362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:3.0:1789265408.634374:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533786880:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265408.634431:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533786880:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 60us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265408.634438:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00080000:0.0:1789265408.634497:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1789265408.914456:0:11151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd912af200 20000000:00000080:2.0:1789265408.914474:0:11151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92543b9d7400 uarg=0000000000000000 20000000:01000000:2.0:1789265408.914591:0:11151:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265408.914598:0:11151:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265408.914603:0:11151:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789265408.915459:0:11152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789265408.917155:0:11151:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789265408.929222:0:11151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265408.931135:0:11151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931158:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f49f expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931168:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931191:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931200:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931207:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931214:0:11151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931271:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931288:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 12 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.931301:0:11151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553743744:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265408.931437:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931446:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 12 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.931456:0:11151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553743872:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265408.931488:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931508:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 18 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.931517:0:11151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553744000:0@lo:104: 00000100:00100000:3.0:1789265408.931559:0:11151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265408.931605:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931613:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 18 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.931622:0:11151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553744128:0@lo:104: 00000100:00100000:3.0:1789265408.931643:0:11151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265408.931665:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f49f expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.931674:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f49f expref: 18 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.931682:0:11151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553744256:0@lo:104: 00000100:00100000:3.0:1789265408.931716:0:11151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265408.931729:0:11151:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265408.932152:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553744000 00000100:00100000:2.0:1789265408.932160:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553744000 00000100:00100000:2.0:1789265408.932207:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553744128 00000100:00100000:2.0:1789265408.932210:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553744128 00000100:00100000:2.0:1789265408.932223:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553744256 00000100:00100000:2.0:1789265408.932226:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553744256 00000100:00100000:2.0:1789265408.932242:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265408.932252:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:11151:x1876180553744000:12345-0@lo:104: 00010000:00010000:2.0:1789265408.932266:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932374:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265408.932380:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:11151:x1876180553744000:12345-0@lo:104: Request processed in 130us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265408.932388:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265408.932407:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265408.932414:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:11151:x1876180553744128:12345-0@lo:104: 00010000:00010000:2.0:1789265408.932422:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932469:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265408.932474:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:11151:x1876180553744128:12345-0@lo:104: Request processed in 61us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265408.932480:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265408.932493:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265408.932499:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:11151:x1876180553744256:12345-0@lo:104: 00010000:00010000:2.0:1789265408.932506:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932534:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265408.932540:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:11151:x1876180553744256:12345-0@lo:104: Request processed in 41us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265408.932545:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789265408.932566:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265408.932572:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932590:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254013c3c00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265408.932595:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932604:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265408.932612:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265408.932618:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265408.932651:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932658:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265408.932680:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932688:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254013c3c00/0x8e12577ef818f4bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932702:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265408.932706:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932712:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265408.932714:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932732:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265408.932738:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265408.932743:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265408.932762:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932768:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265408.932785:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932792:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef818f4ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932804:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265408.932807:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932814:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254013c2600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265408.932817:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932824:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265408.932831:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265408.932843:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265408.932858:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932864:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265408.932886:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932892:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254013c2600/0x8e12577ef818f49f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f4a6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265408.932908:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265408.932911:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265408.932912:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265408.932921:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265408.932943:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553744384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265408.934614:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553744512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265408.934618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265408.936099:0:11151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553744000:0@lo:104: 00000100:00100000:3.0:1789265408.936116:0:11151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553744128:0@lo:104: 00000100:00100000:3.0:1789265408.936125:0:11151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553744256:0@lo:104: 00000100:00100000:1.0:1789265408.936258:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553744640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265408.936775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265408.936989:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553744384 00000100:00100000:3.0:1789265408.936997:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553744384 00010000:00010000:3.0:1789265408.937048:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 19 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.937081:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553744512 00000100:00100000:3.0:1789265408.937084:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553744512 00010000:00010000:3.0:1789265408.937098:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 20 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.937113:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265408.937122:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+20:3305:x1876180553744384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265408.937134:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265408.937139:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 20 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.937149:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 20 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.937167:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136200/0x8e12577ef818f4c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f4bb expref: 20 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.937185:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265408.937223:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553744384:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265408.937230:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265408.938010:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265408.938020:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:3306:x1876180553744512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265408.938031:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265408.938037:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 18 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.938063:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 18 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.938076:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207ce00/0x8e12577ef818f4b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f4ad expref: 18 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.938090:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265408.938129:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:3306:x1876180553744512:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265408.938136:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265408.938316:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553744384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265408.938570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265408.938662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265408.938690:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533787008 00000100:00100000:0.0:1789265408.938697:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533787008 00010000:00010000:0.0:1789265408.938722:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 13 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265408.938740:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533787136 00000100:00100000:0.0:1789265408.938743:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533787136 00010000:00010000:0.0:1789265408.938754:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 14 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265408.938766:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:0.0:1789265408.938773:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+14:2343:x1876180533787008:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265408.938784:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265408.938789:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 14 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.938805:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 14 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.938819:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265408.938867:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+14:2343:x1876180533787008:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265408.938874:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:0.0:1789265408.938888:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:0.0:1789265408.938895:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+13:2343:x1876180533787136:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265408.938903:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265408.938907:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 13 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.938917:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 13 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.938927:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265408.938944:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+13:2343:x1876180533787136:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265408.938950:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:0.0:1789265408.938982:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553744512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265408.939738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265408.939901:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553744640 00000100:00100000:0.0:1789265408.939908:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553744640 00010000:00010000:0.0:1789265408.939930:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f49f expref: 17 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265408.939964:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265408.939972:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:3307:x1876180553744640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265408.939982:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265408.939987:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f49f expref: 17 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940012:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f49f expref: 17 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940026:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207de00/0x8e12577ef818f4a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f49f expref: 17 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940040:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940048:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940064:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940071:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940078:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940085:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940092:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265408.940096:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940104:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940125:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.940135:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265408.940219:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:3307:x1876180553744640:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265408.940226:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789265408.940505:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207d400/0x8e12577ef818f4de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8378 expref: 12 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.940517:0:11151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553743744:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265408.940530:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254013c3000/0x8e12577ef818f4c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8340 expref: 11 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265408.940539:0:11151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876180553743872:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265408.940568:0:11151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.940578:0:11151:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.940583:0:11151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265408.940589:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441885a00/0x8e12577ef818f4fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265408.942274:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553744640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265409.566578:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265410.080598:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265410.080608:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9253050fe800 from 7 10000000:01000000:2.0:1789265410.080615:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265410.080670:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.080683:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.080711:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.080737:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553744768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.080828:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.080881:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254032809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265410.080905:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553744768 00000100:00100000:2.0:1789265410.080912:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553744768 00000100:00100000:2.0:1789265410.080965:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789265410.080976:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553744768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265410.080991:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265410.081004:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f501 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.081028:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f501 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.081038:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f501 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.081047:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136c00, rc 0) 00000100:00100000:2.0:1789265410.081086:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553744768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.081093:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789265410.081144:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553744768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265410.081157:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.081173:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.081246:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553744896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.081272:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.081287:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254032809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265410.081299:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553744896 00000100:00100000:2.0:1789265410.081302:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553744896 00000100:00100000:2.0:1789265410.081352:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789265410.081360:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553744896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.081620:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553744896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.081627:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789265410.081661:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553744896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.081685:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.081723:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.081736:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254032809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265410.081749:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553745024 00000100:00100000:2.0:1789265410.081752:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553745024 00000100:00100000:2.0:1789265410.081773:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789265410.081779:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553745024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.081924:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553745024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.081932:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789265410.081973:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789265410.096629:0:11172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789265410.096933:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789265410.096959:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265410.096971:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.096983:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265410.096994:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265410.096997:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92543b68a800 from 7 10000000:01000000:2.0:1789265410.097000:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265410.097039:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.097047:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.097059:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.097088:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.097168:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.097230:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.097397:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553745152 00000100:00100000:3.0:1789265410.097405:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553745152 00000100:00100000:3.0:1789265410.097454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789265410.097465:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553745152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.097481:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265410.097497:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f50f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.097522:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f50f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.097535:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f50f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.097544:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885a00, rc 0) 00000100:00100000:3.0:1789265410.097584:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553745152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.097590:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789265410.097682:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265410.097697:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.097708:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.097795:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.097822:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.097852:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.097981:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553745280 00000100:00100000:3.0:1789265410.097986:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553745280 00000100:00100000:3.0:1789265410.098018:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789265410.098025:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553745280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.098287:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553745280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.098295:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789265410.098514:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.098550:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.098591:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.098621:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.099477:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553745408 00000100:00100000:3.0:1789265410.099487:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553745408 00000100:00100000:3.0:1789265410.099543:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789265410.099552:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553745408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.099757:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553745408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.099765:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789265410.100473:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265410.102144:0:11173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789265410.105876:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789265410.105917:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265410.105931:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.105945:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265410.105960:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265410.105964:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925409ebd800 from 7 10000000:01000000:2.0:1789265410.105967:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265410.106017:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.106025:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.106037:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.106084:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.106157:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.106372:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.106925:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553745536 00000100:00100000:3.0:1789265410.106933:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553745536 00000100:00100000:3.0:1789265410.107024:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789265410.107035:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553745536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.107051:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265410.107066:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f51d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.107092:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f51d expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.107104:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f51d expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.107114:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884400, rc 0) 00000100:00100000:3.0:1789265410.107167:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553745536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.107174:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789265410.107269:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265410.107283:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.107292:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.107389:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.107419:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.107695:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.107791:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553745664 00000100:00100000:0.0:1789265410.107804:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553745664 00000100:00100000:0.0:1789265410.107828:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789265410.107835:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553745664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.108103:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553745664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.108121:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789265410.108317:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.108390:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.108432:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.108449:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.108754:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553745792 00000100:00100000:0.0:1789265410.108759:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553745792 00000100:00100000:0.0:1789265410.108793:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789265410.108800:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553745792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.108951:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553745792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.108959:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789265410.109099:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553745792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265410.110430:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789265410.110865:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789265410.110890:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265410.110901:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.110937:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.486416:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265410.486988:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533787264 00000100:00100000:3.0:1789265410.486999:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533787264 00000100:00100000:3.0:1789265410.487061:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 238 00000100:00100000:3.0:1789265410.487071:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:5588:x1876180533787264:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.487088:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265410.487126:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83a2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.487160:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.487173:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.487183:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884800, rc 0) 00000100:00100000:3.0:1789265410.487255:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533787264:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 186us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.487261:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 238 00000100:00100000:2.0:1789265410.495397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265410.496936:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533787392 00000100:00100000:3.0:1789265410.496952:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533787392 00000100:00100000:3.0:1789265410.497047:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 239 00000100:00100000:3.0:1789265410.497058:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533787392:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.497411:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533787392:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 354us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.497420:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 239 00000100:00100000:2.0:1789265410.501943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265410.506581:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533787520 00000100:00100000:1.0:1789265410.506606:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533787520 00000100:00100000:1.0:1789265410.506681:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 240 00000100:00100000:1.0:1789265410.506693:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533787520:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.506988:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533787520:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 296us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.506996:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 240 00000100:00100000:2.0:1789265410.517486:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265410.517629:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533787648 00000100:00100000:1.0:1789265410.517642:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533787648 00000100:00100000:1.0:1789265410.517725:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 241 00000100:00100000:1.0:1789265410.517736:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533787648:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265410.517754:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265410.517775:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83a9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.517804:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.517817:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.517826:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5e600, rc 0) 00000100:00100000:1.0:1789265410.517897:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533787648:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 163us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.517905:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 241 00000100:00100000:2.0:1789265410.528244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265410.529626:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533787776 00000100:00100000:3.0:1789265410.529644:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533787776 00000100:00100000:3.0:1789265410.529734:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 242 00000100:00100000:3.0:1789265410.529748:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533787776:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.530251:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533787776:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 503us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.530260:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 242 00000100:00100000:2.0:1789265410.538123:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265410.538458:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533787904 00000100:00100000:0.0:1789265410.538469:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533787904 00000100:00100000:0.0:1789265410.538522:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 243 00000100:00100000:0.0:1789265410.538533:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533787904:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.539142:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533787904:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 607us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.539152:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 243 00010000:00010000:2.0:1789265410.591815:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265410.985738:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553745920:0@lo:400:kworker.0 00000100:00100000:1.0:1789265410.985814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.987828:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553745920 00000100:00100000:3.0:1789265410.987842:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553745920 00000100:00100000:3.0:1789265410.987907:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789265410.987918:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553745920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993115:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553746048:0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.993230:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553746560:0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.993284:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265410.993291:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553746432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.993378:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553746176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.993421:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265410.993427:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553746304:0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.993483:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553746048 00000100:00100000:0.0:1789265410.993489:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553746048 00000100:00100000:0.0:1789265410.993548:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553746432 00000100:00100000:0.0:1789265410.993551:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553746432 00000100:00100000:0.0:1789265410.993577:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553746176 00000100:00100000:0.0:1789265410.993579:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553746176 00000100:00100000:0.0:1789265410.993596:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789265410.993604:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553746048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993650:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553746048:12345-0@lo:400:kworker.0 Request processed in 47us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.993658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789265410.993677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265410.993683:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553746432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993709:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553746432:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.993715:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265410.993728:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789265410.993734:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553746176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993759:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553746176:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.993765:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789265410.993791:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553746560 00000100:00100000:0.0:1789265410.993794:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553746560 00000100:00100000:0.0:1789265410.993818:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553746304 00000100:00100000:0.0:1789265410.993821:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553746304 00000100:00100000:0.0:1789265410.993839:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265410.993845:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553746560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993875:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553746560:12345-0@lo:400:kworker.0 Request processed in 30us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.993889:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265410.993901:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265410.993907:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553746304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.993938:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553746304:12345-0@lo:400:kworker.0 Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.993944:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789265410.993960:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265410.993964:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265410.993967:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789265410.994004:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402c48380 x1876180553746304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265410.994017:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553746304:0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.994030:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553746176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.994063:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553746432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265410.994074:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553746048:0@lo:400:kworker.0 00010000:00080000:0.0:1789265410.994084:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402c4b480 x1876180553746560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265410.994092:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553746560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265410.998282:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553745920:12345-0@lo:400:kworker.0 Request processed in 10351us (12453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.998298:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789265410.998521:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553745920:0@lo:400:kworker.0 00000100:00100000:0.0:1789265411.489107:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553746688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265411.489242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265411.489323:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553746688 00000100:00100000:1.0:1789265411.489351:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553746688 00000100:00100000:1.0:1789265411.489399:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265411.489410:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553746688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265411.489443:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265411.489496:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553746688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265411.489503:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789265411.489600:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402c4bb80 x1876180553746688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265411.489618:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553746688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265411.620096:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265412.638486:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265412.720470:0:11349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789265413.534657:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265413.534866:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553746816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265413.534935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265413.535075:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553746816 00000100:00100000:1.0:1789265413.535084:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553746816 00000100:00100000:1.0:1789265413.535157:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265413.535180:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553746816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265413.535216:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265413.535273:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553746816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265413.535280:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789265413.535895:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3eb100 x1876180553746816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265413.545375:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265413.550247:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553746816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265413.666221:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265413.750061:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265413.750115:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265413.750153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265413.750274:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533788160 00000100:00100000:0.0:1789265413.750286:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533788160 00000100:00080000:2.0:1789265413.750562:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265413.750598:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533788288 00000100:00100000:2.0:1789265413.750602:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533788288 00000100:00100000:2.0:1789265413.750635:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:2.0:1789265413.750644:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533788160:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265413.750718:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2345:x1876180533788160:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 75us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265413.750726:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:2.0:1789265413.750744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00100000:2.0:1789265413.750751:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533788288:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265413.750775:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533788288:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 25us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265413.750781:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00080000:2.0:1789265413.750890:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265413.751074:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533788032 00000100:00100000:3.0:1789265413.751079:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533788032 00000100:00100000:3.0:1789265413.751111:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 245 00000100:00100000:3.0:1789265413.751118:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533788032:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265413.751157:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533788032:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 39us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265413.751164:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 245 00010000:00010000:0.0:1789265414.688901:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265415.710607:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265416.094947:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553747072:0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265416.095083:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553747584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265416.095421:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789265416.095428:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553746944:0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265416.095481:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553747456:0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265416.095536:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553747200:0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265416.095576:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265416.095582:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553747328:0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265416.095635:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553747072 00000100:00100000:0.0:1789265416.095642:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553747072 00000100:00100000:0.0:1789265416.095703:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553747456 00000100:00100000:0.0:1789265416.095706:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553747456 00000100:00100000:0.0:1789265416.095733:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553747200 00000100:00100000:0.0:1789265416.095736:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553747200 00000100:00100000:0.0:1789265416.095751:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789265416.095760:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553747072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095815:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553747072:12345-0@lo:400:kworker.0 Request processed in 55us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265416.095822:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789265416.095839:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265416.095845:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553747456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095870:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553747456:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265416.095875:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265416.095886:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265416.095891:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553747200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265416.095919:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553747200:12345-0@lo:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265416.095924:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265416.095959:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553747584 00000100:00100000:0.0:1789265416.095963:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553747584 00000100:00100000:1.0:1789265416.097283:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553747328 00000100:00100000:1.0:1789265416.097294:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553747328 00000100:00100000:1.0:1789265416.106111:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265416.106142:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553747584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265416.106260:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553747584:12345-0@lo:400:kworker.0 Request processed in 136us (11137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265416.106268:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265416.106292:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265416.106299:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553747328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265416.106362:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553747328:12345-0@lo:400:kworker.0 Request processed in 64us (10759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265416.106369:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265416.106411:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553746944 00000100:00100000:1.0:1789265416.106419:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553746944 00000100:00100000:1.0:1789265416.106460:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789265416.106467:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553746944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265416.106494:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553746944:12345-0@lo:400:kworker.0 Request processed in 29us (11035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265416.106500:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1789265416.106564:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265416.106569:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265416.106572:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265416.106606:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553746944:0@lo:400:kworker.0 00000100:00100000:1.0:1789265416.106625:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553747456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265416.106637:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553747072:0@lo:400:kworker.0 00010000:00080000:1.0:1789265416.106649:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540353f480 x1876180553747584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265416.106660:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553747584:0@lo:400:kworker.0 00010000:00080000:1.0:1789265416.106741:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402c48380 x1876180553747328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265416.106750:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553747328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265416.106762:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553747200:0@lo:400:kworker.0 00000100:00100000:3.0:1789265416.609550:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540a4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553747712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265416.609696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265416.609920:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553747712 00000100:00100000:2.0:1789265416.609929:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553747712 00000100:00100000:2.0:1789265416.610374:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265416.610394:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553747712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265416.610445:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265416.610506:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553747712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265416.610514:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789265416.610559:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540a4e8700 x1876180553747712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265416.610581:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540a4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553747712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265416.734990:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265416.735481:0:11449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:10:14 (1789265414) === 00000100:00100000:0.0:1789265417.097568:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.097717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265417.097905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533788544 00000100:00100000:3.0:1789265417.097918:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533788544 00000100:00100000:3.0:1789265417.097983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1789265417.097993:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:9671:x1876180533788544:12345-192.168.204.43@tcp:700:mkdir.0 00000100:00100000:3.0:1789265417.098083:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:9671:x1876180533788544:12345-192.168.204.43@tcp:700:mkdir.0 Request processed in 90us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.098091:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00080000:0.0:1789265417.100526:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265417.101471:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265417.106176:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533788416 00000100:00100000:1.0:1789265417.106202:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533788416 00000100:00100000:1.0:1789265417.106276:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533788800 00000100:00100000:1.0:1789265417.106280:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533788800 00000100:00100000:1.0:1789265417.106314:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1789265417.106324:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533788416:12345-192.168.204.43@tcp:41:mkdir.0 00000004:00000024:1.0:1789265417.106394:0:9387:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789265417.106489:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533788416:12345-192.168.204.43@tcp:41:mkdir.0 Request processed in 166us (8931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265417.106497:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:2.0:1789265417.106622:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:2.0:1789265417.106645:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:9671:x1876180533788800:12345-192.168.204.43@tcp:36:mkdir.0 00010000:00010000:2.0:1789265417.106700:0:9189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265417.106782:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92544207c400/0x8e12577ef818f41a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f832b expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.106818:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540cd7aa00) 00010000:00010000:2.0:1789265417.106831:0:9189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265417.110460:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.110487:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.110501:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.111783:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.111802:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.111813:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265417.119085:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265417.119108:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.119120:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.119127:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.119134:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265417.119139:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.119147:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.119163:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540ccf3c00) 00010000:00010000:2.0:1789265417.119167:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265417.119171:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.119177:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f539 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265417.119211:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011f48a14 reply state 000000004ae14d4e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265417.119222:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265417.119361:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:9671:x1876180533788800:12345-192.168.204.43@tcp:36:mkdir.0 Request processed in 12696us (17863us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789265417.119390:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00010000:00010000:3.0:1789265417.129525:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.129546:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.129569:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.129576:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265417.129580:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.129588:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.129606:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92540ccf3a00) 00010000:00010000:3.0:1789265417.129609:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265417.129614:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.129619:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f540 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265417.149105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265417.149156:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533788928 00000100:00100000:3.0:1789265417.149167:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533788928 00000100:00100000:3.0:1789265417.149231:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1789265417.149244:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:9673:x1876180533788928:12345-192.168.204.43@tcp:101:chmod.0 00010000:00010000:3.0:1789265417.149272:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265417.149298:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83b0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.149400:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818f54e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.149436:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818f54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.149449:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818f54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265417.149489:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265417.149493:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265417.149536:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818f54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.149565:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83b0 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.149586:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818f54e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83b0 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.149596:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265417.149599:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265417.149602:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885800, rc 0) 00000100:00100000:3.0:1789265417.149674:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:9673:x1876180533788928:12345-192.168.204.43@tcp:101:chmod.0 Request processed in 432us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.149681:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:2.0:1789265417.155559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.155769:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533789184 00000100:00100000:0.0:1789265417.155781:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533789184 00000100:00100000:0.0:1789265417.155846:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:0.0:1789265417.155857:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:9673:x1876180533789184:12345-192.168.204.43@tcp:36:chmod.0 00010000:00010000:0.0:1789265417.155992:0:9387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265417.156315:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818f54e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83b0 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.156387:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9700) 00010000:00010000:0.0:1789265417.156399:0:9387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265417.156430:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.156445:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.156455:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265417.157725:0:9387:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b592acb reply state 0000000031f4e3e7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265417.157740:0:9387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789265417.157752:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789265417.157872:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:9673:x1876180533789184:12345-192.168.204.43@tcp:36:chmod.0 Request processed in 2012us (2321us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789265417.157880:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00010000:00010000:2.0:1789265417.169037:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.169056:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.169064:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.169145:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265417.169150:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.169158:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.169200:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265417.169204:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265417.169209:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.169215:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818f555 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265417.201778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265417.201862:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533789312 00000100:00100000:1.0:1789265417.201873:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533789312 00000100:00100000:1.0:1789265417.201940:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:1.0:1789265417.201951:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:9674:x1876180533789312:12345-192.168.204.43@tcp:101:chown.0 00010000:00010000:1.0:1789265417.201979:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265417.202004:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f55c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83b7 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.202089:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.202105:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.202116:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265417.202156:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265417.202178:0:9189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265417.202256:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.202288:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f55c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83b7 expref: 9 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.202310:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83b7 expref: 8 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.202319:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540cd7af00) 00010000:00010000:1.0:1789265417.202322:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265417.202327:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f600, rc 0) 00000100:00100000:1.0:1789265417.202483:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:9674:x1876180533789312:12345-192.168.204.43@tcp:101:chown.0 Request processed in 533us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265417.202491:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:0.0:1789265417.205887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265417.206311:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533789440 00000100:00100000:3.0:1789265417.206324:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533789440 00000100:00100000:3.0:1789265417.206440:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:3.0:1789265417.206452:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:9674:x1876180533789440:12345-192.168.204.43@tcp:101:chown.0 00010000:00010000:3.0:1789265417.206478:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265417.206530:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f56a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83be expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206647:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206668:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206681:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206698:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206705:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206712:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206831:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f57f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206840:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206846:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265417.206889:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265417.206892:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265417.206915:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206934:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206941:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206948:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206953:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265417.206957:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206965:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206984:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540cd7af00) 00010000:00010000:3.0:1789265417.206986:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265417.206991:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.206997:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.207642:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.207650:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.207657:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.207671:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265417.207676:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.208475:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.208497:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff925409ab9a00) 00010000:00010000:3.0:1789265417.208500:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265417.208505:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.208510:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.208573:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f56a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83be expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.208589:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f57f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83be expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.208597:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9200) 00010000:00010000:3.0:1789265417.208599:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265417.208601:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884000, rc 0) 00000100:00100000:3.0:1789265417.208769:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:9674:x1876180533789440:12345-192.168.204.43@tcp:101:chown.0 Request processed in 2317us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.208779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265417.213506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.213772:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533789696 00000100:00100000:0.0:1789265417.213800:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533789696 00000100:00100000:0.0:1789265417.213872:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:0.0:1789265417.213883:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:9674:x1876180533789696:12345-192.168.204.43@tcp:36:chown.0 00010000:00010000:0.0:1789265417.213945:0:9387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265417.213975:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f57f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83be expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.213997:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9200) 00010000:00010000:0.0:1789265417.214326:0:9387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265417.219778:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.219807:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.219821:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265417.271116:0:9387:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f0b5c13 reply state 00000000e37f1397 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265417.271135:0:9387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789265417.271151:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789265417.271278:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:9674:x1876180533789696:12345-192.168.204.43@tcp:36:chown.0 Request processed in 57392us (57780us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789265417.271304:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000001:00080000:3.0:1789265417.278617:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1789265417.278683:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1789265417.281435:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.281455:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.281464:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.281471:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ee00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265417.281476:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.281484:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.281505:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92540cd7a500) 00010000:00010000:1.0:1789265417.281509:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789265417.281515:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.281521:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f586 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265417.292069:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265417.292260:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533789824 00000100:00100000:3.0:1789265417.292275:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533789824 00000100:00100000:3.0:1789265417.292395:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:3.0:1789265417.292409:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:9675:x1876180533789824:12345-192.168.204.43@tcp:101:touch.500 00010000:00010000:3.0:1789265417.292442:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265417.292467:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f58d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83c5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265417.295080:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2541us 00010000:00010000:3.0:1789265417.323943:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.323968:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.323980:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.323998:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324005:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324011:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324452:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f5a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324472:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324479:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265417.324504:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265417.324508:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265417.324549:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324563:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324570:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324577:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324583:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265417.324588:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324595:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324608:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540cd7af00) 00010000:00010000:3.0:1789265417.324611:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265417.324615:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324646:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324662:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324668:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324673:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324679:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265417.324682:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324688:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324696:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff925409ab9a00) 00010000:00010000:3.0:1789265417.324699:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265417.324702:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324706:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f59b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324746:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f58d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83c5 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324760:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f5a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83c5 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.324773:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9500) 00010000:00010000:3.0:1789265417.324775:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789265417.324778:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:3.0:1789265417.324865:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:9675:x1876180533789824:12345-192.168.204.43@tcp:101:touch.500 Request processed in 32458us (32808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.324875:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:2.0:1789265417.337400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265417.337827:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533790080 00000100:00100000:3.0:1789265417.337837:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533790080 00000100:00100000:3.0:1789265417.337916:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1789265417.337927:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:9675:x1876180533790080:12345-192.168.204.43@tcp:101:touch.500 00010000:00010000:3.0:1789265417.337952:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265417.337975:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f5a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83cc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.340538:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.340559:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.340571:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.340645:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.340653:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.340673:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265417.342553:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789265417.343271:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f5be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343292:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f5be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343305:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f5be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343520:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343528:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343535:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343541:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265417.343545:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343552:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343565:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9500) 00010000:00010000:3.0:1789265417.343568:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265417.343583:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343590:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265417.343604:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066322058 reply state 00000000a64807ee transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265417.343613:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789265417.343835:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f5a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83cc expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343851:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f5be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83cc expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.343858:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff925409ab9f00) 00010000:00010000:3.0:1789265417.343860:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265417.343863:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884600, rc 0) 00000100:00100000:3.0:1789265417.344010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:9675:x1876180533790080:12345-192.168.204.43@tcp:101:touch.500 Request processed in 6083us (6621us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789265417.344018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1789265417.350600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265417.350679:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533790336 00000100:00100000:1.0:1789265417.350700:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533790336 00000100:00100000:1.0:1789265417.350765:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:1.0:1789265417.350776:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:9675:x1876180533790336:12345-192.168.204.43@tcp:36:touch.500 00010000:00010000:1.0:1789265417.350841:0:9387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265417.350884:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f5be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83cc expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.350905:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff925409ab9f00) 00010000:00010000:1.0:1789265417.350917:0:9387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265417.350970:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.350984:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265417.350995:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265417.351154:0:9387:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c03b5e64 reply state 00000000c6837da3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265417.351165:0:9387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265417.351284:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:9675:x1876180533790336:12345-192.168.204.43@tcp:36:touch.500 Request processed in 509us (698us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265417.351292:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00010000:00010000:3.0:1789265417.353900:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.353920:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.353928:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.353957:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265417.353962:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.353971:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.353989:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92540cd7a500) 00010000:00010000:3.0:1789265417.353992:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265417.353997:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.354003:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f5cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.354486:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.354496:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.354503:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.354509:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265417.354512:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.354518:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.354528:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff925409ab9a00) 00010000:00010000:2.0:1789265417.354531:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265417.354534:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.354540:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818f5b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265417.356514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.356614:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533790464 00000100:00100000:0.0:1789265417.356624:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533790464 00000100:00100000:0.0:1789265417.356696:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:0.0:1789265417.356708:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:9675:x1876180533790464:12345-192.168.204.43@tcp:101:touch.500 00010000:00010000:0.0:1789265417.356734:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265417.356757:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f5d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83d3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.356816:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83d3 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.356828:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83d3 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.356844:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92542b074000) 00010000:00010000:0.0:1789265417.356847:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265417.356850:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994400, rc 0) 00000100:00100000:0.0:1789265417.356905:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:9675:x1876180533790464:12345-192.168.204.43@tcp:101:touch.500 Request processed in 200us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.356927:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:1.0:1789265417.361004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.361113:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533790592 00000100:00100000:0.0:1789265417.361123:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533790592 00000100:00100000:0.0:1789265417.361174:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:0.0:1789265417.361190:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876180533790592:12345-192.168.204.43@tcp:8:touch.500 00010000:00080000:0.0:1789265417.361227:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:0.0:1789265417.361265:0:6681:0:(genops.c:1385:class_connect()) connect: client b9773a89-f93c-421a-9c50-bfa3d5c6f2fa, cookie 0x8e12577ef818f5da 00002000:00100000:0.0:1789265417.361278:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b9773a89-f93c-421a-9c50-bfa3d5c6f2fa/ffff92540c279000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265417.361304:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789265417.361582:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789265417.361614:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92540c278000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265417.362011:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2341:x1876180533790592:12345-192.168.204.43@tcp:8:touch.500 Request processed in 826us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.362020:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1789265417.365527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.365825:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533790720 00000100:00100000:0.0:1789265417.365836:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533790720 00000100:00100000:0.0:1789265417.365975:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:0.0:1789265417.365986:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:0:x1876180533790720:12345-192.168.204.43@tcp:2:touch.500 00000100:00080000:1.0:1789265417.366870:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265417.415388:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:0:x1876180533790720:12345-192.168.204.43@tcp:2:touch.500 Request processed in 49393us (49860us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789265417.415403:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000001:00080000:3.0:1789265417.415489:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1789265417.415501:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000100:00100000:3.0:1789265417.418377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.418467:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533790976 00000100:00100000:0.0:1789265417.418477:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533790976 00000100:00100000:0.0:1789265417.418546:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:0.0:1789265417.418556:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:9675:x1876180533790976:12345-192.168.204.43@tcp:35:touch.500 00000100:00100000:0.0:1789265417.418962:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:9675:x1876180533790976:12345-192.168.204.43@tcp:35:touch.500 Request processed in 405us (628us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789265417.418971:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:2.0:1789265417.434440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265417.434582:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533791104 00000100:00100000:3.0:1789265417.434593:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533791104 00000100:00100000:3.0:1789265417.434669:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:3.0:1789265417.434679:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:9676:x1876180533791104:12345-192.168.204.43@tcp:101:rm.0 00010000:00010000:3.0:1789265417.434722:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265417.434746:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83da expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.434842:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.434858:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.434872:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265417.434910:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265417.434914:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265417.434954:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.434984:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef818f5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83da expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.435005:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83da expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.435015:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9500) 00010000:00010000:3.0:1789265417.435018:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265417.435021:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884a00, rc 0) 00000100:00100000:3.0:1789265417.435602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:9676:x1876180533791104:12345-192.168.204.43@tcp:101:rm.0 Request processed in 920us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.435610:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:3.0:1789265417.446201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.446421:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533791360 00000100:00100000:0.0:1789265417.446432:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533791360 00000100:00100000:0.0:1789265417.446501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:0.0:1789265417.446512:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:9676:x1876180533791360:12345-192.168.204.43@tcp:101:rm.0 00010000:00010000:0.0:1789265417.446535:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265417.446555:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818f5ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83e1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265417.446650:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789265417.446826:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818f5ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83e1 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.446841:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540cd7af00) 00010000:00010000:0.0:1789265417.446844:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265417.446850:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818f5ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83e1 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.446864:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995400, rc 0) 00000100:00100000:0.0:1789265417.446987:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:9676:x1876180533791360:12345-192.168.204.43@tcp:101:rm.0 Request processed in 476us (808us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789265417.446995:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:0.0:1789265417.470909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265417.471045:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533791488 00000100:00100000:3.0:1789265417.471082:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533791488 00000100:00100000:3.0:1789265417.471148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:3.0:1789265417.471158:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:9676:x1876180533791488:12345-192.168.204.43@tcp:37:rm.0 00000100:00100000:3.0:1789265417.475394:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:9676:x1876180533791488:12345-192.168.204.43@tcp:37:rm.0 Request processed in 4172us (4429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.475408:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:0.0:1789265417.478741:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265417.479093:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533791744 00000100:00100000:2.0:1789265417.479105:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533791744 00000100:00100000:2.0:1789265417.479168:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:2.0:1789265417.479189:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:9676:x1876180533791744:12345-192.168.204.43@tcp:35:rm.0 00000100:00100000:2.0:1789265417.479505:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:9676:x1876180533791744:12345-192.168.204.43@tcp:35:rm.0 Request processed in 327us (775us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789265417.479526:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:0.0:1789265417.489234:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265417.489586:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533792000 00000100:00100000:2.0:1789265417.489598:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533792000 00000100:00100000:2.0:1789265417.489719:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:2.0:1789265417.489730:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:9676:x1876180533792000:12345-192.168.204.43@tcp:101:rm.0 00010000:00010000:2.0:1789265417.489756:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265417.489779:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f5fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83e8 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.489876:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f604 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.489891:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.489904:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265417.489915:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265417.490105:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f5fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83e8 expref: 17 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.490129:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83e8 expref: 16 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.490139:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9500) 00010000:00010000:2.0:1789265417.490142:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265417.490145:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137e00, rc 0) 00000100:00100000:2.0:1789265417.490244:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:9676:x1876180533792000:12345-192.168.204.43@tcp:101:rm.0 Request processed in 515us (1021us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789265417.490251:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:1.0:1789265417.493878:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265417.498276:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533792128 00000100:00100000:3.0:1789265417.498293:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533792128 00000100:00100000:2.0:1789265417.502526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:2.0:1789265417.502542:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:9676:x1876180533792128:12345-192.168.204.43@tcp:41:rm.0 00000004:00000024:2.0:1789265417.502610:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789265417.502696:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:9676:x1876180533792128:12345-192.168.204.43@tcp:41:rm.0 Request processed in 157us (8829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265417.502704:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:3.0:1789265417.505642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.509468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533792256 00000100:00100000:0.0:1789265417.509483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533792256 00000100:00100000:0.0:1789265417.509637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:0.0:1789265417.509649:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:9676:x1876180533792256:12345-192.168.204.43@tcp:101:rm.0 00010000:00010000:0.0:1789265417.509673:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265417.509697:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509766:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509781:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509794:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509810:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509816:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509822:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509929:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509937:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.509960:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265417.509987:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789265417.509991:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265417.510303:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.510318:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.510326:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512459:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512471:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512478:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265417.512482:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512492:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512508:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9500) 00010000:00010000:0.0:1789265417.512512:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265417.512530:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512561:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f619 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512583:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512589:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512596:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512600:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265417.512603:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512609:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512617:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff92542b074800) 00010000:00010000:0.0:1789265417.512620:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265417.512623:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512628:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512679:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83ef expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512694:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83ef expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.512710:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92542b074000) 00010000:00010000:0.0:1789265417.512712:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265417.512715:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994600, rc 0) 00000100:00100000:0.0:1789265417.512803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:9676:x1876180533792256:12345-192.168.204.43@tcp:101:rm.0 Request processed in 3156us (7172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.512812:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:3.0:1789265417.515910:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265417.516029:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533792512 00000100:00100000:2.0:1789265417.516039:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533792512 00000100:00100000:2.0:1789265417.516108:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:2.0:1789265417.516120:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:9676:x1876180533792512:12345-192.168.204.43@tcp:36:rm.0 00010000:00010000:2.0:1789265417.516193:0:9189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789265417.516226:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83ef expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516254:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f5d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83d3 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516265:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92542b074000) 00010000:00010000:2.0:1789265417.516282:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f5e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83da expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516291:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9500) 00010000:00010000:2.0:1789265417.516294:0:9189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265417.516383:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516399:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516410:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516425:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516433:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516440:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516574:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516583:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.516591:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265417.517416:0:9189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789265417.517429:0:9189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 272751096705ns, next at 273751093938ns, rc = 0 00010000:00010000:2.0:1789265417.517501:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517513:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517528:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517536:0:9189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517542:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517548:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517574:0:9189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265417.517593:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517599:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517605:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517610:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265417.517614:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517621:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517632:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92540ccf3c00) 00010000:00010000:2.0:1789265417.517635:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789265417.517645:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517652:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f63c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517672:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517678:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517683:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517689:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265417.517692:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517698:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517706:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9500) 00010000:00010000:2.0:1789265417.517709:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265417.517711:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.517716:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f62e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265417.517726:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b8c90f9 reply state 00000000ce3b34da transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265417.517745:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265417.517834:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:9676:x1876180533792512:12345-192.168.204.43@tcp:36:rm.0 Request processed in 1713us (1932us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789265417.517842:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00010000:00010000:0.0:1789265417.519945:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265417.519959:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.519969:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265417.519972:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.519982:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.520477:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92540ccf3c00) 00010000:00010000:0.0:1789265417.520483:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265417.520489:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.520495:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f643 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.520521:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265417.520524:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265417.520526:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265417.521032:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.521042:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.521050:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.521056:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265417.521228:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.521238:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.521253:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff92540ccf3d00) 00010000:00010000:2.0:1789265417.521256:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265417.521259:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.521266:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265417.523982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265417.524036:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533792768 00000100:00100000:2.0:1789265417.524047:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533792768 00000100:00100000:2.0:1789265417.524321:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:2.0:1789265417.524357:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:9676:x1876180533792768:12345-192.168.204.43@tcp:35:rm.0 00000100:00100000:2.0:1789265417.524627:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:9676:x1876180533792768:12345-192.168.204.43@tcp:35:rm.0 Request processed in 295us (655us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789265417.524635:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:3.0:1789265417.528674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265417.528960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533793024 00000100:00100000:0.0:1789265417.528987:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533793024 00000100:00100000:0.0:1789265417.529091:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:0.0:1789265417.529102:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:9676:x1876180533793024:12345-192.168.204.43@tcp:36:rm.0 00010000:00010000:0.0:1789265417.529161:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789265417.529202:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83e8 expref: 16 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529232:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f5a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83c5 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529246:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff925409ab9500) 00010000:00010000:0.0:1789265417.529263:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83b7 expref: 14 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529272:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540cd7af00) 00010000:00010000:0.0:1789265417.529279:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265417.529305:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529318:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529328:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529396:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529405:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529424:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529701:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529716:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.529725:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265417.530517:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789265417.530537:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.530546:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.530553:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.530560:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265417.530564:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531755:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531779:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265417.531783:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789265417.531805:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531812:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f658 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531843:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531850:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531856:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531861:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265417.531864:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531871:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531880:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074800) 00010000:00010000:0.0:1789265417.531882:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265417.531885:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.531900:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f64a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265417.531912:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afbe1818 reply state 0000000040438f84 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265417.531932:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265417.532445:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:9676:x1876180533793024:12345-192.168.204.43@tcp:36:rm.0 Request processed in 3335us (3771us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789265417.532455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00010000:00010000:0.0:1789265417.536500:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.536520:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.536527:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.536534:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265417.536538:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.536546:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.536564:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92542b074900) 00010000:00010000:0.0:1789265417.536567:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265417.536571:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.536650:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f651 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.758735:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789265418.654765:0:7152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 273888430297ns, next at 274888427298ns, rc = 0 00000100:00100000:3.0:1789265418.654785:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265418.654825:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553747840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265418.654937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265418.656789:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553747840 00000100:00100000:2.0:1789265418.656805:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553747840 00000100:00080000:1.0:1789265418.656901:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265418.656914:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265418.656927:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553747840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265418.656958:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265418.657067:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553747840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265418.657077:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789265418.657143:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437503100 x1876180553747840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265418.657189:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553747840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265418.791816:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265418.871309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265418.871371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265418.871409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265418.871443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265418.871513:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533793152 00000100:00100000:2.0:1789265418.871526:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533793280 00000100:00100000:3.0:1789265418.871527:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533793152 00000100:00100000:2.0:1789265418.871530:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533793280 00000100:00100000:3.0:1789265418.871590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 247 00000100:00100000:2.0:1789265418.871592:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533793536 00000100:00100000:2.0:1789265418.871594:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533793536 00000100:00100000:3.0:1789265418.871602:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533793152:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265418.871635:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:2.0:1789265418.871641:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2345:x1876180533793280:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265418.871697:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533793152:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265418.871704:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 247 00000100:00100000:0.0:1789265418.871728:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:0.0:1789265418.871737:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533793536:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265418.871744:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533793408 00000100:00100000:3.0:1789265418.871747:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533793408 00000100:00100000:3.0:1789265418.871782:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:3.0:1789265418.871789:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533793408:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265418.874050:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2345:x1876180533793280:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 2385us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265418.874068:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00080000:2.0:1789265418.874124:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265418.874579:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533793536:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 2825us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265418.875040:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:3.0:1789265418.877244:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533793408:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 5434us (5778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265418.877261:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00010000:00010000:2.0:1789265419.806585:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265420.830581:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265421.214543:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553748096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.214575:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553747968:0@lo:400:kworker.0 00000100:00100000:2.0:1789265421.218006:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553748352:0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.218443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265421.218522:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553748480:0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.218562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265421.218601:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553748480 00000100:00100000:0.0:1789265421.218611:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553748480 00000100:00100000:0.0:1789265421.220032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265421.220062:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553748480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.220183:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553748480:12345-0@lo:400:kworker.0 Request processed in 135us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265421.220192:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1789265421.220236:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265421.220297:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553748480:0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.220361:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265421.220373:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553748608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.220419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265421.220467:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553748608 00000100:00100000:0.0:1789265421.220474:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553748608 00000100:00100000:0.0:1789265421.220524:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265421.220533:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553748608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.220576:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553748608:12345-0@lo:400:kworker.0 Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265421.220583:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789265421.220616:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789265421.220645:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185f100 x1876180553748608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265421.220659:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553748608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.220723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553747968 00000100:00100000:0.0:1789265421.220728:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553747968 00000100:00100000:1.0:1789265421.220912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265421.221786:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265421.222037:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789265421.222058:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553747968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.222154:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553747968:12345-0@lo:400:kworker.0 Request processed in 104us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265421.222164:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789265421.222618:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265421.222632:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553748224:0@lo:400:kworker.0 00000100:00100000:2.0:1789265421.222672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265421.222710:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553748096 00000100:00100000:2.0:1789265421.222719:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553748096 00000100:00100000:2.0:1789265421.222771:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553748224 00000100:00100000:2.0:1789265421.222775:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553748224 00000100:00100000:2.0:1789265421.222963:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789265421.222972:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265421.223034:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553748096:12345-0@lo:400:kworker.0 Request processed in 63us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265421.223041:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789265421.223056:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789265421.223063:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553748224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265421.223096:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553748224:12345-0@lo:400:kworker.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265421.223117:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789265421.223150:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265421.223196:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553748224:0@lo:400:kworker.0 00000100:00100000:2.0:1789265421.223250:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553748096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265421.223466:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553747968:0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.227935:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553748352 00000100:00100000:0.0:1789265421.227958:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553748352 00000100:00100000:0.0:1789265421.228060:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265421.228073:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553748352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265421.228225:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553748352:12345-0@lo:400:kworker.0 Request processed in 154us (6443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265421.228233:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1789265421.228299:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92544185e300 x1876180553748352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265421.228317:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553748352:0@lo:400:kworker.0 00000100:00080000:2.0:1789265421.229792:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265421.727990:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553748736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265421.728068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265421.738117:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553748736 00000100:00100000:2.0:1789265421.738132:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553748736 00000100:00100000:2.0:1789265421.738197:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265421.738206:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553748736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265421.738245:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265421.738314:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553748736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (10245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265421.738321:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789265421.738390:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437503480 x1876180553748736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265421.738410:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553748736:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789265421.788935:0:11600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1789265421.855444:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789265422.304370:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1789265422.304413:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789265422.304439:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789265422.304670:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553748864:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789265422.304758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265422.304834:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553748864 00000100:00100000:0.0:1789265422.304854:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553748864 00000100:00100000:0.0:1789265422.304936:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265422.304953:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553748864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789265422.305681:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1789265422.305749:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa60608, atime: 0x6aa60608, ctime: 0x6aa60608, blocks: 0x1 00010000:00010000:0.0:1789265422.305759:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265422.305784:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1789265422.305790:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265422.305799:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265422.305822:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265422.305835:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265422.305843:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265422.305869:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265422.305916:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265422.305931:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265422.305945:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265422.305951:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265422.305962:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265422.305989:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265422.305996:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef818f65f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265422.306039:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265422.306041:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265422.306042:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265422.309482:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553748864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4518us (4709us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789265422.309503:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1789265422.309535:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff925437503480/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789265422.309556:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553748864:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789265422.824933:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1789265422.882754:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265423.016391:0:11649:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1d688e70 20000000:00000080:0.0:1789265423.016415:0:11649:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92543b7dd800 uarg=0000000000000000 20000000:01000000:0.0:1789265423.016463:0:11649:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789265423.016472:0:11649:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789265423.016477:0:11649:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789265423.017286:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789265423.021308:0:11649:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789265423.030980:0:11649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789265423.031079:0:11649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789265423.031150:0:11649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789265423.031173:0:11649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789265423.031202:0:11649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031231:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f501 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031242:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f50f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031249:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f51d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031261:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031269:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031278:0:11649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031377:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031403:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.031425:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553748992:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265423.031589:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031598:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.031607:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553749120:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265423.031643:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f51d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031653:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f51d expref: 18 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.031663:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553749248:0@lo:104: 00000100:00100000:1.0:1789265423.031723:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265423.031781:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f50f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031790:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f50f expref: 18 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.031811:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553749376:0@lo:104: 00000100:00100000:1.0:1789265423.031833:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265423.031854:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef818f501 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.031862:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef818f501 expref: 18 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.031870:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553749504:0@lo:104: 00000100:00100000:1.0:1789265423.031892:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265423.031903:0:11649:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b419c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265423.032151:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789265423.032190:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553749248 00000100:00100000:3.0:1789265423.032200:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553749248 00000100:00100000:3.0:1789265423.032248:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553749376 00000100:00100000:3.0:1789265423.032251:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553749376 00000100:00100000:3.0:1789265423.032260:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553749504 00000100:00100000:3.0:1789265423.032262:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553749504 00000100:00100000:3.0:1789265423.032275:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265423.032284:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:11649:x1876180553749248:12345-0@lo:104: 00010000:00010000:3.0:1789265423.032297:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.032488:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265423.032503:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+5:11649:x1876180553749248:12345-0@lo:104: Request processed in 219us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.032510:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265423.032534:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265423.032540:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:11649:x1876180553749376:12345-0@lo:104: 00010000:00010000:3.0:1789265423.032549:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.032583:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265423.032588:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+4:11649:x1876180553749376:12345-0@lo:104: Request processed in 49us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.032594:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265423.032607:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265423.032613:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b7dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:11649:x1876180553749504:12345-0@lo:104: 00010000:00010000:3.0:1789265423.032621:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.032648:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789265423.032653:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b7dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+3:11649:x1876180553749504:12345-0@lo:104: Request processed in 41us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.032659:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789265423.033240:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265423.033250:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.033259:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265423.033263:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.033273:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265423.033280:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265423.033286:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265423.033360:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.033376:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265423.033412:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265423.033453:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553749632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265423.033503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265423.034010:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789265423.034119:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553749632 00000100:00100000:0.0:1789265423.034138:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553749632 00010000:00010000:0.0:1789265423.034171:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f51d expref: 19 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.034181:0:11651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265423.034189:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.034207:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137200 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265423.034211:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.034218:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265423.034224:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265423.034229:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789265423.034255:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789265423.034257:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.034263:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789265423.034264:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553749632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265423.034275:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.034280:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265423.034282:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef818f50f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f516 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.034285:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f51d expref: 19 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.034294:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265423.034296:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265423.034296:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f51d expref: 19 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265423.034298:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265423.034307:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265423.034316:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540a4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553749760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265423.034319:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265423.034376:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553749632:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.034383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265423.034384:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265423.034404:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553749760 00000100:00100000:0.0:1789265423.034408:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553749760 00010000:00010000:0.0:1789265423.034419:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f50f expref: 19 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265423.034429:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553749632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265423.034431:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265423.034569:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553749760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265423.034579:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265423.034584:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f50f expref: 19 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.034593:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f50f expref: 19 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.034680:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265423.034722:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553749760:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265423.034729:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789265423.034800:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265423.034803:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265423.034804:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265423.034809:0:11651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.034816:0:11651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:0.0:1789265423.034819:0:11651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.034826:0:11651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265423.034833:0:11651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265423.034839:0:11651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789265423.034857:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540a4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553749760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265423.034865:0:11651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.034871:0:11651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265423.034902:0:11651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.034910:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403137a00/0x8e12577ef818f501 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f508 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265423.034916:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553749888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265423.034935:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265423.034938:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265423.034940:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265423.034946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265423.034968:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553749888 00000100:00100000:0.0:1789265423.034972:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553749888 00010000:00010000:0.0:1789265423.034988:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f501 expref: 19 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265423.035017:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265423.035024:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553749888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265423.035032:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265423.035037:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef818f501 expref: 19 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.035045:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef818f501 expref: 19 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.035056:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265423.035103:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553749888:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265423.035109:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265423.035151:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553749888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265423.035372:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef818f51d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef818f524 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.035409:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265423.035411:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265423.035413:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265423.039455:0:11649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441884400/0x8e12577ef818f524 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f51d expref: 18 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.039485:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553749248:0@lo:104: 00010000:00010000:1.0:1789265423.039501:0:11649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441885a00/0x8e12577ef818f516 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f50f expref: 17 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.039511:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553749376:0@lo:104: 00010000:00010000:1.0:1789265423.039535:0:11649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136c00/0x8e12577ef818f508 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef818f501 expref: 16 pid: 5825 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.039544:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553749504:0@lo:104: 00000100:00100000:1.0:1789265423.040792:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553748992:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265423.040809:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1876180553749120:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265423.040866:0:11649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265423.043906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265423.043986:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533793664 00000100:00100000:3.0:1789265423.044012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265423.044083:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533793664 00010000:00010000:0.0:1789265423.044138:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265423.044180:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533793792 00000100:00100000:0.0:1789265423.044184:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533793792 00000100:00100000:1.0:1789265423.044197:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:1.0:1789265423.044214:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+13:2343:x1876180533793664:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265423.044234:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265423.044242:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.044257:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.044280:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92543bc5e600/0x8e12577ef818f532 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a9 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.044300:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265423.044315:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265423.044367:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789265423.044376:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789265423.044508:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789265423.044531:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:2.0:1789265423.044541:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f248648a-8946-448c-8146-af0e3c141002+13:2343:x1876180533793792:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265423.044551:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265423.044556:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.044565:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.044576:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441884800/0x8e12577ef818f52b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83a2 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.044589:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.044598:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265423.044829:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+12:2343:x1876180533793664:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 619us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265423.044837:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00010000:00010000:2.0:1789265423.044899:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.044910:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.044918:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.044932:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.044939:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265423.044944:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.045021:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.045044:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265423.045056:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265423.045107:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f248648a-8946-448c-8146-af0e3c141002+11:2343:x1876180533793792:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 568us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265423.045115:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00010000:00010000:1.0:1789265423.045176:0:11649:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.045186:0:11649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.045193:0:11649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92543bc5e000/0x8e12577ef818f666 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265423.775769:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553750016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265423.775870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265423.777824:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553750016 00000100:00100000:2.0:1789265423.777844:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553750016 00000100:00100000:2.0:1789265423.777973:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265423.777987:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553750016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265423.778042:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265423.778166:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553750016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265423.778174:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265423.778238:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789265423.778247:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff925437503480, transno 4294967300 00000100:00100000:1.0:1789265423.778306:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553750016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265423.778976:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265423.902536:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265423.989283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265423.989376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265423.989385:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533793920 00000100:00100000:0.0:1789265423.989401:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533793920 00000100:00100000:3.0:1789265423.989430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265423.989480:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 249 00000100:00100000:3.0:1789265423.989484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265423.989498:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:2342:x1876180533793920:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265423.989605:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+11:2342:x1876180533793920:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 112us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265423.989614:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 249 00000100:00100000:2.0:1789265423.989967:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533794048 00000100:00100000:1.0:1789265423.989967:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533794176 00000100:00100000:2.0:1789265423.989972:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533794048 00000100:00100000:1.0:1789265423.989972:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533794176 00000100:00100000:1.0:1789265423.990128:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:1.0:1789265423.990136:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533794176:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265423.990176:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533794176:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 42us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265423.990183:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:3.0:1789265423.991846:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533794304 00000100:00100000:3.0:1789265423.991867:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533794304 00000100:00100000:0.0:1789265423.993705:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:0.0:1789265423.993727:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533794048:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265423.993861:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533794048:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 142us (4430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265423.993872:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00080000:1.0:1789265423.994092:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265423.994101:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265423.995757:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:3.0:1789265423.995774:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533794304:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265423.995864:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533794304:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 95us (6381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.995873:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 99 10000000:01000000:0.0:1789265424.479468:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265424.479481:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9253050fe800 from 7 10000000:01000000:0.0:1789265424.479497:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265424.479572:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265424.479589:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265424.479640:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265424.479681:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265424.479789:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265424.479875:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a5c6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265424.479931:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553750144 00000100:00100000:3.0:1789265424.479943:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553750144 00000100:00100000:3.0:1789265424.480032:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789265424.480054:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:5831:x1876180553750144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265424.480074:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265424.480094:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441885400/0x8e12577ef818f674 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f66d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265424.480151:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885400/0x8e12577ef818f674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f66d expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265424.480164:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441885400/0x8e12577ef818f674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f66d expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265424.480177:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885400, rc 0) 00000100:00100000:3.0:1789265424.480238:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553750144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265424.480247:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789265424.480262:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265424.480283:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.480295:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265424.480413:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.480445:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265424.480476:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265424.480708:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553750272 00000100:00100000:0.0:1789265424.480713:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553750272 00000100:00100000:0.0:1789265424.480751:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789265424.480759:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553750272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265424.481373:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553750272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 612us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265424.481381:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789265424.481724:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.481778:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.481829:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265424.481870:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b41780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265424.482008:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553750400 00000100:00100000:3.0:1789265424.482014:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553750400 00000100:00100000:3.0:1789265424.482070:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789265424.482080:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553750400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265424.482291:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553750400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265424.482299:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789265424.482418:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265424.483129:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11665:1876180553750528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265424.483180:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265424.483224:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a5c6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265424.484092:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553750528 00000100:00100000:1.0:1789265424.484104:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553750528 00000100:00100000:1.0:1789265424.484174:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789265424.484187:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:11665:x1876180553750528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265424.484548:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:11665:x1876180553750528:12345-0@lo:502:llog_process_th.0 Request processed in 364us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265424.484556:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789265424.484787:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11665:1876180553750528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265424.484827:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265424.484840:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265424.484843:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265424.484854:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9253050fe800 00000020:00000080:0.0:1789265424.484857:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789265424.485731:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11665:1876180553750656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265424.485799:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265424.485836:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553750656 00000100:00100000:0.0:1789265424.485849:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553750656 00000100:00100000:0.0:1789265424.485892:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789265424.485901:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:11665:x1876180553750656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265424.486849:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:11665:x1876180553750656:12345-0@lo:502:llog_process_th.0 Request processed in 945us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265424.486857:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789265424.486916:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a5c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265424.487774:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11665:1876180553750656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265424.487829:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265424.487839:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265424.487841:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789265424.487852:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789265424.497740:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789265424.497795:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265424.497810:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.497826:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265424.497840:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265424.497843:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92543b68a800 from 7 10000000:01000000:1.0:1789265424.497846:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265424.497899:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.498119:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.498133:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265424.498165:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.498316:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265424.498406:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265424.498442:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553750784 00000100:00100000:1.0:1789265424.498452:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553750784 00000100:00100000:1.0:1789265424.498578:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789265424.498588:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+17:5831:x1876180553750784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265424.498606:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265424.498623:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92543bc5ea00/0x8e12577ef818f682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f67b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.498656:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92543bc5ea00/0x8e12577ef818f682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f67b expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.498669:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92543bc5ea00/0x8e12577ef818f682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f67b expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.498680:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5ea00, rc 0) 00000100:00100000:1.0:1789265424.498727:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553750784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265424.498733:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789265424.498790:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265424.498807:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.498817:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265424.498878:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.498971:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265424.500784:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b419c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265424.506402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553750912 00000100:00100000:3.0:1789265424.506429:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553750912 00000100:00100000:3.0:1789265424.506548:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789265424.506563:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553750912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265424.507284:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553750912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 720us (8307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265424.507295:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789265424.517552:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553750912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.517656:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553751040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.517769:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265424.517828:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265424.517908:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553751040 00000100:00100000:0.0:1789265424.517919:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553751040 00000100:00100000:0.0:1789265424.518009:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789265424.518020:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553751040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265424.518278:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553751040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265424.518287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789265424.519080:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553751040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.519577:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11667:1876180553751168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265424.519664:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265424.519711:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265424.519882:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553751168 00000100:00100000:0.0:1789265424.519892:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553751168 00000100:00100000:0.0:1789265424.519950:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789265424.519961:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:11667:x1876180553751168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265424.520217:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:11667:x1876180553751168:12345-0@lo:502:llog_process_th.0 Request processed in 257us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265424.520226:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789265424.521084:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11667:1876180553751168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265424.521132:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265424.521147:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265424.521151:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265424.521159:0:11667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92543b68a800 00000020:00000080:1.0:1789265424.521162:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265424.521279:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11667:1876180553751296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265424.521372:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265424.521410:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553751296 00000100:00100000:1.0:1789265424.521416:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553751296 00000100:00100000:1.0:1789265424.521456:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789265424.521465:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:11667:x1876180553751296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265424.522100:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265424.525120:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:11667:x1876180553751296:12345-0@lo:502:llog_process_th.0 Request processed in 3642us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265424.525137:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789265424.525458:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11667:1876180553751296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265424.525682:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265424.525694:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265424.525696:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789265424.525713:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789265424.526789:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789265424.526823:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265424.526839:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265424.526857:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265424.526872:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265424.526876:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925409ebd800 from 7 10000000:01000000:0.0:1789265424.526880:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265424.527692:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265424.527707:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265424.527724:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265424.527759:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553751424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265424.527842:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265424.527898:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a5c60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265424.528633:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553751424 00000100:00100000:1.0:1789265424.528646:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553751424 00000100:00100000:1.0:1789265424.528719:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789265424.528732:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:5831:x1876180553751424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265424.528753:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265424.528776:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92543bc5f800/0x8e12577ef818f690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef818f689 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.528812:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92543bc5f800/0x8e12577ef818f690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef818f689 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.528827:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92543bc5f800/0x8e12577ef818f690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef818f689 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.528839:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f800, rc 0) 00000100:00100000:1.0:1789265424.528922:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553751424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265424.528929:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789265424.529143:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553751424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265424.529184:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265424.529195:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265424.529315:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553751552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265424.529377:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265424.529397:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925441360b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265424.530073:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553751552 00000100:00100000:0.0:1789265424.530082:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553751552 00000100:00100000:0.0:1789265424.530118:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789265424.530126:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+20:5831:x1876180553751552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265424.532117:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553751552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1979us (2728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265424.532134:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789265424.532765:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553751552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265424.532844:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553751680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265424.534039:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265424.534201:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553751680 00000100:00100000:1.0:1789265424.534214:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553751680 00000100:00100000:1.0:1789265424.534289:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789265424.534301:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553751680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265424.534604:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff925441360b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265424.535154:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:5831:x1876180553751680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 851us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265424.535163:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789265424.535666:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:5831:1876180553751680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265424.537179:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11669:1876180553751808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265424.537273:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265424.537348:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff925441360cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265424.538067:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553751808 00000100:00100000:1.0:1789265424.538081:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553751808 00000100:00100000:1.0:1789265424.538150:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789265424.538169:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:11669:x1876180553751808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265424.539742:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:11669:x1876180553751808:12345-0@lo:502:llog_process_th.0 Request processed in 1563us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265424.539757:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789265424.539917:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11669:1876180553751808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265424.539976:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265424.539989:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265424.539992:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265424.540001:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff925409ebd800 00000020:00000080:3.0:1789265424.540005:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265424.540141:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11669:1876180553751936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265424.540198:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265424.540240:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553751936 00000100:00100000:3.0:1789265424.540247:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553751936 00000100:00100000:3.0:1789265424.540296:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789265424.540315:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:11669:x1876180553751936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265424.540541:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:11669:x1876180553751936:12345-0@lo:502:llog_process_th.0 Request processed in 228us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265424.540548:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789265424.540593:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff925441360cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265424.540605:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:11669:1876180553751936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265424.540627:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265424.540632:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265424.540634:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789265424.540638:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789265424.541842:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789265424.541882:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265424.541898:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265424.541914:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265424.562869:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265424.629821:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265424.630597:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533794432 00000100:00100000:2.0:1789265424.630611:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533794432 00000100:00100000:2.0:1789265424.630688:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 265 00000100:00100000:2.0:1789265424.630700:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+11:5588:x1876180533794432:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265424.630725:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265424.630749:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136400/0x8e12577ef818f697 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83f6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265424.630788:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136400/0x8e12577ef818f697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83f6 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265424.630800:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136400/0x8e12577ef818f697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83f6 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265424.630811:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136400, rc 0) 00000100:00100000:2.0:1789265424.630882:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533794432:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 184us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265424.630889:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 265 00000100:00100000:0.0:1789265424.639950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265424.640047:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533794560 00000100:00100000:1.0:1789265424.640061:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533794560 00000100:00100000:1.0:1789265424.640210:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 266 00000100:00100000:1.0:1789265424.640224:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533794560:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265424.641495:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533794560:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 1256us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265424.641510:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 266 00000100:00100000:1.0:1789265424.648852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265424.649053:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533794688 00000100:00100000:3.0:1789265424.649066:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533794688 00000100:00100000:3.0:1789265424.649245:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 267 00000100:00100000:3.0:1789265424.649256:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533794688:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265424.649591:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533794688:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 335us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265424.650179:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 267 00000100:00100000:1.0:1789265424.660263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265424.660374:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533794816 00000100:00100000:0.0:1789265424.660388:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533794816 00000100:00100000:0.0:1789265424.660453:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 268 00000100:00100000:0.0:1789265424.660465:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+12:9947:x1876180533794816:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265424.660892:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+12:9947:x1876180533794816:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 427us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265424.660903:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 268 00000100:00100000:1.0:1789265424.667998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265424.668139:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533794944 00000100:00100000:3.0:1789265424.668154:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533794944 00000100:00100000:3.0:1789265424.668229:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 269 00000100:00100000:3.0:1789265424.668243:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+12:9947:x1876180533794944:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265424.668944:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+12:9947:x1876180533794944:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 700us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265424.668955:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 269 00000100:00100000:2.0:1789265424.676450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265424.676542:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533795072 00000100:00100000:3.0:1789265424.676571:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533795072 00000100:00100000:3.0:1789265424.676684:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 270 00000100:00100000:3.0:1789265424.676696:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+12:5588:x1876180533795072:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265424.676717:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265424.676740:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441885600/0x8e12577ef818f69e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f83fd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265424.676775:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885600/0x8e12577ef818f69e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83fd expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265424.676789:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441885600/0x8e12577ef818f69e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83fd expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265424.676800:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885600, rc 0) 00000100:00100000:3.0:1789265424.676884:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533795072:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 190us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265424.676892:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 270 00000100:00100000:0.0:1789265424.680202:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265424.680381:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533795200 00000100:00100000:2.0:1789265424.680397:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533795200 00000100:00100000:2.0:1789265424.680469:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 271 00000100:00100000:2.0:1789265424.680482:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533795200:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265424.680898:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533795200:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 417us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265424.680907:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 271 00000100:00100000:2.0:1789265424.690997:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265424.691236:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533795328 00000100:00100000:0.0:1789265424.691250:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533795328 00000100:00100000:0.0:1789265424.691419:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 272 00000100:00100000:0.0:1789265424.691434:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533795328:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265424.692955:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:5588:x1876180533795328:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 1506us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265424.692970:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 272 00000100:00100000:1.0:1789265424.702671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265424.702845:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533795456 00000100:00100000:2.0:1789265424.702862:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533795456 00000100:00100000:2.0:1789265424.702945:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 273 00000100:00100000:2.0:1789265424.702957:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:9950:x1876180533795456:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265424.703999:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:9950:x1876180533795456:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 1033us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265424.704014:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 273 00000100:00100000:0.0:1789265424.711233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265424.711412:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533795584 00000100:00100000:1.0:1789265424.711426:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533795584 00000100:00100000:1.0:1789265424.711621:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 274 00000100:00100000:1.0:1789265424.711659:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:9950:x1876180533795584:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265424.712282:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:9950:x1876180533795584:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 624us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265424.712294:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 274 00010000:00010000:0.0:1789265424.929526:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265425.567464:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265425.950623:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265426.337044:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553752448:0@lo:400:kworker.0 00000100:00100000:1.0:1789265426.337125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265426.337200:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265426.337207:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553752320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265426.337234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265426.337270:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553752448 00000100:00100000:1.0:1789265426.337279:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553752448 00000100:00100000:1.0:1789265426.337361:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265426.337373:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553752448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265426.337431:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553752448:12345-0@lo:400:kworker.0 Request processed in 61us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265426.337438:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265426.337464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553752320 00000100:00100000:1.0:1789265426.337468:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553752320 00000100:00100000:1.0:1789265426.337495:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265426.337502:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553752320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265426.337657:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553752064:0@lo:400:kworker.0 00000100:00080000:0.0:1789265426.337756:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265426.337777:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265426.337821:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553752320:12345-0@lo:400:kworker.0 Request processed in 319us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265426.337828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789265426.337906:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553752192:0@lo:400:kworker.0 00000100:00100000:3.0:1789265426.341643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265426.341713:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553752576:0@lo:400:kworker.0 00000100:00100000:3.0:1789265426.341755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265426.341828:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553752064 00000100:00100000:3.0:1789265426.341836:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553752064 00000100:00100000:3.0:1789265426.341891:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789265426.341901:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553752064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265426.341957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553752064:12345-0@lo:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265426.342014:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789265426.342065:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553752064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265426.342407:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553752576 00000100:00100000:1.0:1789265426.342412:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553752576 00000100:00100000:1.0:1789265426.342467:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265426.342482:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553752576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265426.342540:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553752576:12345-0@lo:400:kworker.0 Request processed in 59us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265426.342548:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789265426.342756:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265426.342786:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553752576:0@lo:400:kworker.0 00000100:00100000:0.0:1789265426.342981:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553752320:0@lo:400:kworker.0 00000100:00100000:0.0:1789265426.342999:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553752448:0@lo:400:kworker.0 00000100:00100000:2.0:1789265426.348763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265426.348915:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553752704:0@lo:400:kworker.0 00000100:00100000:2.0:1789265426.348955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265426.349654:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553752704 00000100:00100000:1.0:1789265426.349664:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553752704 00000100:00100000:1.0:1789265426.349752:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265426.349763:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553752704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265426.349827:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553752704:12345-0@lo:400:kworker.0 Request processed in 66us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265426.349834:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789265426.349912:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789265426.350680:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402c4ad80 x1876180553752704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265426.350696:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553752704:0@lo:400:kworker.0 00000100:00100000:3.0:1789265426.351879:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553752192 00000100:00100000:3.0:1789265426.351888:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553752192 00000100:00100000:3.0:1789265426.352081:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789265426.352091:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553752192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265426.352176:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553752192:12345-0@lo:400:kworker.0 Request processed in 87us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265426.352183:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265426.352251:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553752192:0@lo:400:kworker.0 00000100:00100000:0.0:1789265426.850210:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553752832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265426.850288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265426.850483:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553752832 00000100:00100000:3.0:1789265426.850492:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553752832 00000100:00100000:3.0:1789265426.850546:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265426.850568:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553752832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265426.850608:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265426.850672:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553752832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265426.850680:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789265426.850977:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437500380 x1876180553752832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265426.851007:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553752832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265426.974770:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265427.998960:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265428.895144:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265428.895168:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553752960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265428.895245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265428.895517:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553752960 00000100:00100000:3.0:1789265428.895527:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553752960 00000100:00100000:3.0:1789265428.895602:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265428.895612:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553752960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265428.895649:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265428.895746:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553752960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265428.895755:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265428.895813:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553752960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265428.895839:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265429.022742:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265429.109778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265429.109834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265429.109856:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533795712 00000100:00100000:1.0:1789265429.109866:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533795712 00000100:00100000:3.0:1789265429.109884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265429.109928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265429.109937:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 276 00000100:00100000:3.0:1789265429.109970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533795840 00000100:00100000:1.0:1789265429.109970:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533795712:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265429.109975:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533795840 00000100:00100000:3.0:1789265429.110024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533796096 00000100:00100000:3.0:1789265429.110028:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533796096 00000100:00100000:1.0:1789265429.110051:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533795712:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265429.110054:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:3.0:1789265429.110066:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2344:x1876180533795840:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265429.110068:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 276 00000100:00100000:3.0:1789265429.110108:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2344:x1876180533795840:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 43us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265429.110116:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:3.0:1789265429.110132:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:3.0:1789265429.110138:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533796096:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:0.0:1789265429.110298:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265429.110556:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533795968 00000100:00100000:2.0:1789265429.110561:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533795968 00000100:00080000:0.0:1789265429.110767:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265429.110827:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:2.0:1789265429.110840:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2344:x1876180533795968:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265429.110893:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2344:x1876180533795968:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 57us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265429.113228:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533796096:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 904us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265429.113253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:2.0:1789265429.117074:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00010000:00010000:0.0:1789265430.051721:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265431.071517:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265431.454671:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553753088:0@lo:400:kworker.0 00000100:00100000:3.0:1789265431.454676:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553753472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265431.454730:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553753216:0@lo:400:kworker.0 00000100:00100000:1.0:1789265431.454738:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553753344:0@lo:400:kworker.0 00000100:00100000:2.0:1789265431.456529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265431.456612:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553753728:0@lo:400:kworker.0 00000100:00100000:2.0:1789265431.456728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265431.457142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265431.457188:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553753728 00000100:00100000:1.0:1789265431.457196:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553753728 00000100:00100000:0.0:1789265431.457208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265431.457237:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553753600:0@lo:400:kworker.0 00000100:00100000:1.0:1789265431.457252:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265431.457261:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553753728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265431.457261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265431.457288:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553753216 00000100:00100000:0.0:1789265431.457291:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553753216 00000100:00100000:0.0:1789265431.457329:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553753344 00000100:00100000:0.0:1789265431.457343:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553753344 00000100:00100000:1.0:1789265431.457349:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553753728:12345-0@lo:400:kworker.0 Request processed in 89us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.457355:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265431.457364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553753600 00000100:00100000:0.0:1789265431.457366:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553753600 00000100:00100000:1.0:1789265431.457382:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789265431.457389:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553753216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265431.457420:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553753216:12345-0@lo:400:kworker.0 Request processed in 32us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.457426:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789265431.457440:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265431.457446:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553753344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265431.457476:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553753344:12345-0@lo:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.457482:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1789265431.457498:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265431.457504:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265431.457530:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553753344:0@lo:400:kworker.0 00000100:00100000:1.0:1789265431.457589:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553753088 00000100:00100000:1.0:1789265431.457593:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553753088 00000100:00100000:1.0:1789265431.457618:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789265431.457624:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553753088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265431.457661:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553753088:12345-0@lo:400:kworker.0 Request processed in 37us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.457667:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789265431.457707:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553753088:0@lo:400:kworker.0 00000100:00100000:3.0:1789265431.457873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265431.457973:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553753472 00000100:00100000:1.0:1789265431.457984:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553753472 00000100:00100000:1.0:1789265431.458026:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789265431.458103:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265431.458143:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553753472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265431.458189:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553753472:12345-0@lo:400:kworker.0 Request processed in 157us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.458195:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265431.458261:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553753472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265431.458366:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553753216:0@lo:400:kworker.0 00010000:00080000:2.0:1789265431.458381:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437063480 x1876180553753728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265431.458392:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553753728:0@lo:400:kworker.0 00000100:00100000:0.0:1789265431.458512:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789265431.458520:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553753600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265431.458573:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553753600:12345-0@lo:400:kworker.0 Request processed in 54us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265431.458580:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265431.458718:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553753600:0@lo:400:kworker.0 00000100:00100000:3.0:1789265431.966970:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265431.967022:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553753856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265431.967103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265431.967255:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553753856 00000100:00100000:2.0:1789265431.967264:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553753856 00000100:00100000:2.0:1789265431.967320:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265431.967437:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553753856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265431.967479:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265431.967547:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553753856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 218us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.967554:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789265431.967646:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437503100 x1876180553753856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265431.967667:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553753856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265432.096147:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265433.118658:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265434.016053:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265434.016085:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553753984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265434.016230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265434.016471:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553753984 00000100:00100000:2.0:1789265434.016482:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553753984 00000100:00100000:2.0:1789265434.016611:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265434.016622:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553753984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265434.016660:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265434.016719:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553753984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265434.016746:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265434.016844:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553753984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265434.016946:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265434.142778:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265434.235095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265434.235145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265434.235198:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265434.235245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265434.235288:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533796480 00000100:00100000:0.0:1789265434.235300:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533796480 00000100:00100000:0.0:1789265434.235432:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:0.0:1789265434.235444:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533796480:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265434.235519:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533796480:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265434.235527:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00080000:0.0:1789265434.235678:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265434.236246:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533796352 00000100:00100000:3.0:1789265434.236254:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533796352 00000100:00100000:3.0:1789265434.236309:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533796608 00000100:00100000:3.0:1789265434.236313:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533796608 00000100:00100000:3.0:1789265434.236359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 108 00000100:00100000:3.0:1789265434.236368:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533796352:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265434.236496:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533796352:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 129us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265434.236504:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 108 00000100:00100000:3.0:1789265434.236520:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 109 00000100:00100000:3.0:1789265434.236527:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533796608:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265434.236552:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533796608:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 26us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265434.236560:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 109 00000100:00080000:0.0:1789265434.237056:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265434.237192:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533796224 00000100:00100000:2.0:1789265434.237199:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533796224 00000100:00100000:2.0:1789265434.237248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 278 00000100:00100000:2.0:1789265434.237257:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533796224:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265434.237308:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533796224:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 52us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265434.237315:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 278 00010000:00010000:2.0:1789265435.166603:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265435.807305:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265436.190555:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265436.575216:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553754496:0@lo:400:kworker.0 00000100:00100000:3.0:1789265436.575306:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265436.575397:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265436.575404:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553754368:0@lo:400:kworker.0 00000100:00100000:3.0:1789265436.575429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265436.575460:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553754496 00000100:00100000:3.0:1789265436.575468:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553754496 00000100:00100000:1.0:1789265436.575511:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553754368 00000100:00100000:1.0:1789265436.575515:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553754368 00000100:00100000:3.0:1789265436.575523:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265436.575540:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553754496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265436.575545:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789265436.575552:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553754368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265436.575589:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553754496:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265436.575596:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789265436.575628:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265436.575633:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265436.575637:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553754240:0@lo:400:kworker.0 00000100:00100000:2.0:1789265436.575694:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553754112:0@lo:400:kworker.0 00000100:00100000:2.0:1789265436.575731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265436.575757:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553754624:0@lo:400:kworker.0 00000100:00100000:2.0:1789265436.575779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265436.575834:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553754624 00000100:00100000:2.0:1789265436.575838:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553754624 00000100:00100000:2.0:1789265436.575867:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789265436.575873:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553754624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265436.575907:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553754624:12345-0@lo:400:kworker.0 Request processed in 34us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265436.575914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1789265436.575932:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265436.575983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265436.576006:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553754752:0@lo:400:kworker.0 00000100:00100000:0.0:1789265436.576037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265436.576068:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553754752 00000100:00100000:0.0:1789265436.576072:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553754752 00000100:00100000:0.0:1789265436.576102:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265436.576108:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553754752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265436.576140:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553754752:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265436.576145:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1789265436.576180:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540329c700 x1876180553754752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265436.576195:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553754752:0@lo:400:kworker.0 00000100:00100000:0.0:1789265436.576227:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553754112 00000100:00100000:0.0:1789265436.576230:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553754112 00000100:00100000:0.0:1789265436.576254:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789265436.576260:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553754112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265436.576291:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553754112:12345-0@lo:400:kworker.0 Request processed in 32us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265436.576297:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789265436.576349:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553754240 00000100:00100000:0.0:1789265436.576352:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553754240 00000100:00100000:0.0:1789265436.576374:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789265436.576380:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553754240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265436.576412:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553754240:12345-0@lo:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265436.576417:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789265436.576446:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553754240:0@lo:400:kworker.0 00000100:00080000:0.0:1789265436.576478:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265436.576649:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553754624:0@lo:400:kworker.0 00000100:00100000:2.0:1789265436.576668:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553754112:0@lo:400:kworker.0 00000100:00100000:1.0:1789265436.579559:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553754368:12345-0@lo:400:kworker.0 Request processed in 3996us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265436.579575:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265436.583888:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553754368:0@lo:400:kworker.0 00000100:00100000:3.0:1789265436.583908:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553754496:0@lo:400:kworker.0 00000100:00100000:3.0:1789265437.086899:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265437.090720:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553754880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265437.090838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265437.091131:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553754880 00000100:00100000:2.0:1789265437.091142:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553754880 00000100:00100000:2.0:1789265437.091203:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789265437.091214:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553754880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265437.091257:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265437.091318:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553754880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265437.091325:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789265437.091918:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925437503100 x1876180553754880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265437.091944:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553754880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265437.216226:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265438.239539:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265439.134666:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553755008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265439.134772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265439.136065:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553755008 00000100:00100000:0.0:1789265439.136078:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553755008 00000100:00100000:0.0:1789265439.136177:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265439.136187:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553755008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265439.136228:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265439.136316:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553755008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265439.136322:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265439.136555:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553755008:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265439.136592:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265439.263201:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265439.351209:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265439.351266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265439.351372:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533796736 00000100:00100000:1.0:1789265439.351386:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533796736 00000100:00100000:1.0:1789265439.351450:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 280 00000100:00100000:1.0:1789265439.351460:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2342:x1876180533796736:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265439.351547:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2342:x1876180533796736:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265439.351554:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 280 00000100:00100000:2.0:1789265439.351909:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533796864 00000100:00100000:2.0:1789265439.351915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533796864 00000100:00100000:2.0:1789265439.351981:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:2.0:1789265439.351991:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533796864:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265439.352042:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533796864:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 54us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265439.352049:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00080000:0.0:1789265439.352164:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265439.370102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265439.372833:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533796992 00000100:00100000:3.0:1789265439.372853:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533796992 00000100:00100000:3.0:1789265439.372975:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:3.0:1789265439.372988:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2341:x1876180533796992:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:3.0:1789265439.373027:0:9090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f5da 00000100:00080000:3.0:1789265439.373037:0:9090:0:(import.c:65:import_set_state_nolock()) ffff92540c278000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265439.373089:0:9090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789265439.373430:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+2:2341:x1876180533796992:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 443us (3340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265439.373457:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00080000:0.0:1789265439.373765:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265439.374668:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265439.379848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265439.379980:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533797120 00000100:00100000:0.0:1789265439.379991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533797120 00000100:00100000:0.0:1789265439.380083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:0.0:1789265439.380095:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533797120:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265439.380190:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533797120:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 96us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265439.380207:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00080000:2.0:1789265439.380646:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789265440.286614:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265441.316317:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265441.695445:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553755392:0@lo:400:kworker.0 00000100:00100000:0.0:1789265441.695445:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553755264:0@lo:400:kworker.0 00000100:00100000:2.0:1789265441.695538:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553755136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265441.699101:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553755520:0@lo:400:kworker.0 00000100:00100000:0.0:1789265441.699284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265441.699440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265441.699482:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553755264 00000100:00100000:1.0:1789265441.699490:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553755264 00000100:00100000:0.0:1789265441.699503:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553755776:0@lo:400:kworker.0 00000100:00100000:1.0:1789265441.699544:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553755392 00000100:00100000:0.0:1789265441.699545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265441.699548:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553755392 00000100:00100000:1.0:1789265441.699592:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789265441.699603:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553755264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265441.699604:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553755776 00000100:00100000:0.0:1789265441.699609:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553755776 00000100:00100000:0.0:1789265441.699650:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265441.699658:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553755776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265441.699682:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553755264:12345-0@lo:400:kworker.0 Request processed in 80us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265441.699690:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789265441.699698:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553755776:12345-0@lo:400:kworker.0 Request processed in 41us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265441.699717:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265441.699730:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265441.699739:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553755392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265441.699845:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553755392:0@lo:400:kworker.0 00000100:00080000:0.0:1789265441.699872:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265441.699876:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265441.699907:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553755392:12345-0@lo:400:kworker.0 Request processed in 169us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265441.699915:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265441.699958:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553755264:0@lo:400:kworker.0 00010000:00080000:0.0:1789265441.700025:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540329f480 x1876180553755776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265441.700036:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553755776:0@lo:400:kworker.0 00000100:00100000:3.0:1789265441.701018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265441.701111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265441.701152:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553755648:0@lo:400:kworker.0 00000100:00100000:0.0:1789265441.701312:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553755520 00000100:00100000:0.0:1789265441.701320:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553755520 00000100:00100000:2.0:1789265441.701491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265441.701526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553755648 00000100:00100000:2.0:1789265441.701529:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553755648 00000100:00100000:3.0:1789265441.701578:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553755136 00000100:00100000:3.0:1789265441.701582:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553755136 00000100:00100000:3.0:1789265441.701616:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789265441.701624:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553755136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265441.701679:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553755136:12345-0@lo:400:kworker.0 Request processed in 56us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265441.701685:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789265441.701758:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553755136:0@lo:400:kworker.0 00000100:00100000:0.0:1789265441.701943:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265441.701951:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553755520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265441.701994:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553755520:12345-0@lo:400:kworker.0 Request processed in 45us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265441.702000:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265441.702027:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553755520:0@lo:400:kworker.0 00000100:00080000:1.0:1789265441.702070:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265441.702075:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265441.702204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789265441.702211:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553755648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265441.702272:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553755648:12345-0@lo:400:kworker.0 Request processed in 62us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265441.702284:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789265441.702412:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553755648:0@lo:400:kworker.0 00000100:00100000:0.0:1789265442.206803:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553755904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265442.206917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265442.207081:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553755904 00000100:00100000:1.0:1789265442.207090:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553755904 00000100:00100000:1.0:1789265442.207147:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265442.207156:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553755904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265442.207197:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265442.207254:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553755904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265442.207261:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789265442.207477:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92540c338a80 x1876180553755904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265442.207496:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553755904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265442.334736:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789265443.301267:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:1.0:1789265443.301277:0:6704:0:(genops.c:885:class_export_put()) final put ffff92540c279000/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:3.0:1789265443.301361:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92540c279000/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa for lustre-OST0000 00000020:00000080:3.0:1789265443.301413:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92540c278000 for lustre-OST0000 00010000:00010000:2.0:1789265443.361808:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265444.254501:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265444.254534:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553756032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265444.254631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265444.255450:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553756032 00000100:00100000:1.0:1789265444.255459:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553756032 00000100:00100000:1.0:1789265444.255535:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265444.255545:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553756032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265444.255584:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265444.255643:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553756032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265444.255650:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789265444.255695:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265444.256884:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553756032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265444.382590:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265444.471586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265444.471639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265444.471693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265444.472646:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533797376 00000100:00100000:2.0:1789265444.472668:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533797376 00000100:00100000:2.0:1789265444.472745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533797504 00000100:00100000:2.0:1789265444.472748:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533797504 00000100:00100000:2.0:1789265444.472775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:2.0:1789265444.472784:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533797376:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265444.472862:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533797376:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 79us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265444.472870:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:2.0:1789265444.473238:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:2.0:1789265444.473248:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533797504:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265444.473280:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533797504:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 35us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265444.473287:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:1.0:1789265444.473846:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533797248 00000100:00100000:1.0:1789265444.473854:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533797248 00000100:00100000:1.0:1789265444.473897:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 282 00000100:00100000:1.0:1789265444.473905:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2342:x1876180533797248:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265444.473944:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2342:x1876180533797248:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 41us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265444.473950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 282 00000100:00080000:3.0:1789265444.483793:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789265445.024304:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265445.410191:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265446.431057:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265446.822453:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553756416:0@lo:400:kworker.0 00000100:00100000:2.0:1789265446.822543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265446.822624:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265446.822631:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553756544:0@lo:400:kworker.0 00000100:00100000:2.0:1789265446.822659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265446.822706:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553756416 00000100:00100000:2.0:1789265446.822713:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553756416 00000100:00100000:2.0:1789265446.822771:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265446.822781:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553756416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265446.822832:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553756416:12345-0@lo:400:kworker.0 Request processed in 53us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265446.822840:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265446.822865:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553756544 00000100:00100000:2.0:1789265446.822869:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553756544 00000100:00100000:2.0:1789265446.822897:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265446.822904:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553756544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265446.822935:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553756544:12345-0@lo:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265446.822941:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265446.822981:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553756544:0@lo:400:kworker.0 00000100:00100000:2.0:1789265446.822992:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553756416:0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823190:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553756160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265446.823263:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553756672:0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265446.823309:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265446.823316:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553756288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265446.823377:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553756800:0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265446.823426:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553756672 00000100:00100000:1.0:1789265446.823430:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553756672 00000100:00100000:1.0:1789265446.823482:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553756288 00000100:00100000:1.0:1789265446.823486:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553756288 00000100:00100000:1.0:1789265446.823519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789265446.823526:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553756672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823563:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553756672:12345-0@lo:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265446.823569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789265446.823583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789265446.823589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553756288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823630:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553756288:12345-0@lo:400:kworker.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265446.823637:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789265446.823658:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553756800 00000100:00100000:1.0:1789265446.823662:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553756800 00000100:00100000:1.0:1789265446.823685:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789265446.823692:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553756800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823721:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553756800:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265446.823727:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789265446.823760:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553756288:0@lo:400:kworker.0 00010000:00080000:1.0:1789265446.823772:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925407252a00 x1876180553756800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265446.823789:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553756800:0@lo:400:kworker.0 00000100:00100000:1.0:1789265446.823798:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553756672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265446.825209:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553756160 00000100:00100000:2.0:1789265446.825222:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553756160 00000100:00100000:2.0:1789265446.825292:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789265446.825302:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553756160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265446.825400:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553756160:12345-0@lo:400:kworker.0 Request processed in 100us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265446.825407:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789265446.825628:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553756160:0@lo:400:kworker.0 00000100:00080000:3.0:1789265446.826204:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265446.826209:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265446.826213:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265447.327139:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265447.327164:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553756928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265447.327241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265447.327326:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553756928 00000100:00100000:2.0:1789265447.327351:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553756928 00000100:00100000:2.0:1789265447.327399:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265447.327408:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553756928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265447.327457:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265447.327500:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553756928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265447.327507:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789265447.327553:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925407251180 x1876180553756928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265447.329539:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553756928:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789265447.372417:0:11834:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:10:44 (1789265444) 00010000:00010000:0.0:1789265447.465006:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265448.481914:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265448.967853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265448.969601:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533797632 00000100:00100000:2.0:1789265448.969619:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533797632 00000100:00100000:2.0:1789265448.969839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:2.0:1789265448.969852:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:10216:x1876180533797632:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265448.969872:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265448.969897:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f6a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8404 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265448.969962:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f6ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265448.969975:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265448.970030:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265448.970069:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265448.970072:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265448.970109:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265448.970133:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f6a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8404 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265448.970155:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f6ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8404 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265448.972022:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:2.0:1789265448.972032:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265448.972038:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137200, rc 0) 00000100:00100000:2.0:1789265448.972137:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:10216:x1876180533797632:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 2283us (4287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265448.972147:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00080000:3.0:1789265448.973237:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265448.977655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265448.977743:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533797760 00000100:00100000:1.0:1789265448.977768:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533797760 00000100:00100000:1.0:1789265448.977846:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:1.0:1789265448.977856:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:10217:x1876180533797760:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265448.977877:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265448.977898:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f6b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f840b expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.977989:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978008:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978029:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978046:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978055:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978062:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978680:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fe00/0x8e12577ef818f6c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978692:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fe00/0x8e12577ef818f6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978709:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fe00/0x8e12577ef818f6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265448.978743:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265448.978747:0:9387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265448.978969:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fe00/0x8e12577ef818f6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.978992:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979000:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979007:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979140:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265448.979144:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979153:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979165:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:1.0:1789265448.979169:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265448.979174:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979182:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f6ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979861:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979872:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979877:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979882:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265448.979886:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979892:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979903:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff92540cd7a100) 00010000:00010000:1.0:1789265448.979905:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265448.979907:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979913:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f6c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979959:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f6b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f840b expref: 8 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979973:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fe00/0x8e12577ef818f6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f840b expref: 7 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265448.979998:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92540cd7ac00) 00010000:00010000:1.0:1789265448.980001:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265448.980004:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5fe00, rc 0) 00000100:00100000:1.0:1789265448.980651:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:10217:x1876180533797760:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 2793us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265448.980660:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:2.0:1789265448.986062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265448.986138:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533798016 00000100:00100000:3.0:1789265448.986150:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533798016 00000100:00100000:3.0:1789265448.986206:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:3.0:1789265448.986217:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:10217:x1876180533798016:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265448.986242:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265448.986271:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f6cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8412 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.986499:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.986516:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.986529:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.986604:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.986613:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.986620:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989136:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885a00/0x8e12577ef818f6e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989161:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885a00/0x8e12577ef818f6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989193:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885a00/0x8e12577ef818f6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265448.989213:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789265448.989500:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989509:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989517:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989523:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265448.989528:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989536:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989550:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92540cd7ac00) 00010000:00010000:3.0:1789265448.989553:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265448.989559:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989575:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f6d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989591:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989598:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989612:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989618:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265448.989621:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989628:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.989649:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff925409ab9900) 00010000:00010000:3.0:1789265448.989652:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265448.989656:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.990084:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f6dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.993164:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f6cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8412 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.993193:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885a00/0x8e12577ef818f6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8412 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265448.993204:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:3.0:1789265448.993207:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265448.993210:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885a00, rc 0) 00000100:00100000:3.0:1789265448.993301:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:10217:x1876180533798016:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 7085us (7330us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789265448.993322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:0.0:1789265449.001106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265449.002290:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533798144 00000100:00100000:1.0:1789265449.002304:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533798144 00000100:00100000:1.0:1789265449.002640:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:1.0:1789265449.002652:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:10217:x1876180533798144:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789265449.002787:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:10217:x1876180533798144:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 Request processed in 137us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265449.002795:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000040:00080000:2.0:1789265449.126399:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789265449.374525:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265449.374550:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553757056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265449.374640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265449.374725:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553757056 00000100:00100000:0.0:1789265449.374734:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553757056 00000100:00100000:0.0:1789265449.374795:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265449.374805:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553757056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265449.374844:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265449.374891:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553757056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265449.374898:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789265449.374919:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265449.374958:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553757056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265449.504639:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265449.600448:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265449.600502:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265449.600542:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533798400 00000100:00100000:0.0:1789265449.600551:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533798400 00000100:00100000:0.0:1789265449.600627:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:0.0:1789265449.600638:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533798400:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265449.600718:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533798400:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265449.600725:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00080000:0.0:1789265449.601402:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265449.608228:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533798272 00000100:00100000:3.0:1789265449.608244:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533798272 00000100:00100000:3.0:1789265449.609816:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 284 00000100:00100000:3.0:1789265449.609839:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533798272:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265449.610269:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533798272:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 438us (9838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265449.610280:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 284 00010000:00010000:2.0:1789265450.527862:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265451.552834:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265451.649419:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265451.651220:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533798528 00000100:00100000:2.0:1789265451.651237:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533798528 00000100:00100000:2.0:1789265451.651355:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:2.0:1789265451.651366:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:10260:x1876180533798528:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265451.651403:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265451.651425:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f6f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8419 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651511:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651537:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651550:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651568:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651574:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651581:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651785:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651794:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651800:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651807:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265451.651818:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651826:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651840:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:2.0:1789265451.651843:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265451.651847:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651853:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f6f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651868:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651875:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651881:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651886:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265451.651889:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651894:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651901:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92540ccf3300) 00010000:00010000:2.0:1789265451.651904:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265451.651914:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651920:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f700 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651962:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f6f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8419 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651973:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:2.0:1789265451.651975:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265451.651978:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f6f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8419 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.651987:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137c00, rc 0) 00000100:00100000:2.0:1789265451.652069:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:10260:x1876180533798528:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 702us (2658us total) trans 0 rc 301/301 00000100:00100000:2.0:1789265451.652077:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00080000:3.0:1789265451.652415:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265451.658497:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265451.658600:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533798784 00000100:00100000:3.0:1789265451.658613:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533798784 00000100:00100000:3.0:1789265451.658697:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:3.0:1789265451.658712:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:10260:x1876180533798784:12345-192.168.204.43@tcp:36:lfs.0 00010000:00010000:3.0:1789265451.658780:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265451.658812:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f6ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8404 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.658832:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:3.0:1789265451.658848:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265451.659145:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.659160:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.659172:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.659195:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.659202:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.659209:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265451.660326:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789265451.660376:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.660385:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.660392:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.660398:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265451.660403:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.660410:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.660427:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:3.0:1789265451.660430:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265451.660435:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.660452:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f707 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265451.660473:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c1f867c reply state 00000000204e591b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265451.660484:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265451.660638:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:10260:x1876180533798784:12345-192.168.204.43@tcp:36:lfs.0 Request processed in 1922us (2143us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789265451.660647:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00010000:00010000:2.0:1789265451.670076:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.670094:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.670102:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.670109:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265451.670115:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.670129:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.670147:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff925409ab9d00) 00010000:00010000:2.0:1789265451.670151:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265451.670156:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.670162:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818f70e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265451.777082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265451.777170:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533798912 00000100:00100000:3.0:1789265451.777182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533798912 00000100:00100000:3.0:1789265451.777251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:3.0:1789265451.777262:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:10268:x1876180533798912:12345-192.168.204.43@tcp:101:lctl.0 00010000:00010000:3.0:1789265451.777287:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265451.777313:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8420 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.777487:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f71c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.777502:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.777528:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265451.777566:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265451.777570:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265451.777626:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.777651:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818f715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8420 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.777670:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8420 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.777679:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:3.0:1789265451.777682:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265451.777685:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885c00, rc 0) 00000100:00100000:3.0:1789265451.777753:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:10268:x1876180533798912:12345-192.168.204.43@tcp:101:lctl.0 Request processed in 492us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.777760:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:0.0:1789265451.885791:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265451.885911:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533799040 00000100:00100000:2.0:1789265451.885922:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533799040 00000100:00100000:2.0:1789265451.885988:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:2.0:1789265451.885998:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:10274:x1876180533799040:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265451.886020:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265451.886042:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8427 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886110:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886126:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886137:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886151:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886178:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886185:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886296:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886304:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886311:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265451.886398:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789265451.886403:0:9189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265451.886445:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886457:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886463:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886469:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886476:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265451.886480:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886495:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886508:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:2.0:1789265451.886529:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265451.886534:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886541:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f72a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886558:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886564:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886572:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886577:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265451.886580:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886586:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886594:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92540ccf3300) 00010000:00010000:2.0:1789265451.886597:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265451.886599:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886615:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f731 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886650:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8427 expref: 12 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886663:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8427 expref: 11 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.886671:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265451.886674:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789265451.886676:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136800, rc 0) 00000100:00100000:2.0:1789265451.886741:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:10274:x1876180533799040:12345-192.168.204.43@tcp:101:bash.0 Request processed in 744us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265451.886749:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:1.0:1789265451.892787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265451.892922:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533799296 00000100:00100000:2.0:1789265451.892933:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533799296 00000100:00100000:2.0:1789265451.892989:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:2.0:1789265451.892999:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:10274:x1876180533799296:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265451.893018:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265451.893038:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f73f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f842e expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.893174:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.893188:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.893214:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.893228:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.893235:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.893242:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265451.895969:0:9387:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789265451.896180:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896197:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896208:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896243:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896251:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896258:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896265:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265451.896277:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896286:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896298:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265451.896301:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265451.896305:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.896311:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f746 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265451.896326:0:9387:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000376afc10 reply state 0000000049fd7d4b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265451.897105:0:9387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265451.897159:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f73f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 14 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.897177:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 13 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265451.897186:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3b00) 00010000:00010000:2.0:1789265451.897189:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265451.897191:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137a00, rc 0) 00000100:00100000:2.0:1789265451.897266:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10274:x1876180533799296:12345-192.168.204.43@tcp:101:bash.0 Request processed in 4268us (4489us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789265451.897276:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00010000:00010000:3.0:1789265451.909878:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.909896:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.909904:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.909910:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265451.909915:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.909923:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.909959:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540ccf3300) 00010000:00010000:3.0:1789265451.909963:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265451.909967:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.909974:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f74d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265451.934611:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553757184:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.934655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265451.934679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265451.934817:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553757312:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.934859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265451.939200:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533799424 00000100:00100000:0.0:1789265451.939218:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533799424 00000100:00100000:0.0:1789265451.939290:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:0.0:1789265451.939298:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876180533799424:12345-192.168.204.43@tcp:8:bash.0 00010000:00080000:0.0:1789265451.939381:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:0.0:1789265451.939422:0:6680:0:(genops.c:1385:class_connect()) connect: client b9773a89-f93c-421a-9c50-bfa3d5c6f2fa, cookie 0x8e12577ef818f762 00002000:00100000:0.0:1789265451.939434:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b9773a89-f93c-421a-9c50-bfa3d5c6f2fa/ffff925403fc8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265451.939459:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789265451.939709:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789265451.939744:0:6680:0:(import.c:65:import_set_state_nolock()) ffff925403fca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265451.939826:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2341:x1876180533799424:12345-192.168.204.43@tcp:8:bash.0 Request processed in 526us (5173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265451.939834:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:0.0:1789265451.940644:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553757312 00000100:00100000:0.0:1789265451.940655:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553757312 00000100:00100000:0.0:1789265451.940706:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789265451.940732:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553757312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265451.940813:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553757312:12345-0@lo:400:kworker.0 Request processed in 84us (5953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265451.940821:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789265451.940846:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553757184 00000100:00100000:0.0:1789265451.940850:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553757184 00000100:00100000:0.0:1789265451.940884:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789265451.940890:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553757184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.941715:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553757312:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.943684:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553757440:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.943756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265451.943799:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265451.943805:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553757568:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.943836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265451.943874:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553757568 00000100:00100000:3.0:1789265451.943881:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553757568 00000100:00100000:3.0:1789265451.943951:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265451.943961:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553757568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944009:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553757568:12345-0@lo:400:kworker.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.944017:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789265451.944039:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265451.944078:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553757568:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944122:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553757824:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265451.944168:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265451.944174:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553757696:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265451.944225:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553757824 00000100:00100000:3.0:1789265451.944228:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553757824 00000100:00100000:3.0:1789265451.944256:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265451.944262:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553757824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944297:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553757824:12345-0@lo:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.944303:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789265451.944316:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789265451.944351:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925402c4b800 x1876180553757824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265451.944362:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553757824:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944379:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553757440 00000100:00100000:3.0:1789265451.944382:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553757440 00000100:00100000:3.0:1789265451.944407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553757696 00000100:00100000:3.0:1789265451.944409:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553757696 00000100:00100000:3.0:1789265451.944432:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789265451.944437:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553757440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944468:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553757440:12345-0@lo:400:kworker.0 Request processed in 31us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.944474:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789265451.944483:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789265451.944494:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553757696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944536:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553757696:12345-0@lo:400:kworker.0 Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.944541:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1789265451.944554:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265451.944569:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553757440:0@lo:400:kworker.0 00000100:00100000:3.0:1789265451.944587:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553757696:0@lo:400:kworker.0 00000100:00100000:0.0:1789265451.946907:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553757184:12345-0@lo:400:kworker.0 Request processed in 6006us (12218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265451.946922:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789265451.951547:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553757184:0@lo:400:kworker.0 00000100:00100000:0.0:1789265451.951646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265451.951746:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533799552 00000100:00100000:3.0:1789265451.951757:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533799552 00000100:00100000:3.0:1789265451.951837:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:3.0:1789265451.951848:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:0:x1876180533799552:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265451.951865:0:9090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265451.951891:0:9090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8435 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265451.951921:0:9090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265451.951939:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1789265451.951943:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265451.951953:0:9090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 7 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.951974:0:9090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 7 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265451.951987:0:9090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885000, rc 0) 00000100:00100000:3.0:1789265451.952371:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:0:x1876180533799552:12345-192.168.204.43@tcp:101:bash.0 Request processed in 523us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.952378:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00080000:0.0:1789265451.952814:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265451.957599:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265451.957925:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533799680 00000100:00100000:0.0:1789265451.957939:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533799680 00000100:00100000:0.0:1789265451.958025:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:0.0:1789265451.958036:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:10274:x1876180533799680:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265451.958056:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265451.958079:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f843c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.958111:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 8 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.958120:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265451.958124:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265451.958130:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.958185:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 8 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.958200:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 8 pid: 9090 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265451.958215:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1876180553757952:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265451.958634:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff925407f896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265451.977377:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1876180553757952:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265451.977434:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.977457:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994c00, rc 0) 00000100:00100000:0.0:1789265451.986661:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:10274:x1876180533799680:12345-192.168.204.43@tcp:101:bash.0 Request processed in 28611us (29058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265451.986678:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1789265451.987609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265451.987702:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533799808 00000100:00100000:0.0:1789265451.987712:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533799808 00010000:00010000:0.0:1789265451.987752:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 8 pid: 9090 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265451.987797:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:0.0:1789265451.987808:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533799808:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265451.987841:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265451.987866:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 8 pid: 9090 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.987880:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 8 pid: 9090 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.987907:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818f769 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8435 expref: 8 pid: 9090 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.987925:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265451.987930:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265451.987938:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.987948:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265451.987994:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265451.988569:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1876180553758080:192.168.204.43@tcp:105: 00000100:00100000:0.0:1789265451.988647:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff925407f896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265451.997711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265451.997847:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533800064 00000100:00100000:3.0:1789265451.997857:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533800064 00000100:00100000:3.0:1789265451.997929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:3.0:1789265451.997941:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:10274:x1876180533800064:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:3.0:1789265451.998702:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10274:x1876180533800064:12345-192.168.204.43@tcp:35:bash.0 Request processed in 759us (997us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789265451.998711:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:0.0:1789265451.998830:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1876180553758080:192.168.204.43@tcp:105: 00010000:00010000:0.0:1789265451.998856:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265451.998896:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533799808:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 11091us (11292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265451.998905:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:1.0:1789265452.183521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265452.183819:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533800320 00000100:00100000:2.0:1789265452.183830:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533800320 00000100:00100000:2.0:1789265452.183898:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:2.0:1789265452.183909:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10284:x1876180533800320:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265452.183936:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265452.183957:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8443 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265452.184077:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789265452.184206:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f777 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8443 expref: 16 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.184920:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:2.0:1789265452.184927:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265452.184934:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8443 expref: 16 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.184950:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136200, rc 0) 00000100:00100000:2.0:1789265452.185043:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:10284:x1876180533800320:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1135us (1542us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1789265452.185052:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:1.0:1789265452.189313:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265452.189613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533800576 00000100:00100000:3.0:1789265452.189624:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533800576 00000100:00100000:3.0:1789265452.189693:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:3.0:1789265452.189705:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:10284:x1876180533800576:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265452.189966:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:10284:x1876180533800576:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 263us (663us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789265452.189975:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:2.0:1789265452.385517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265452.385682:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533800704 00000100:00100000:3.0:1789265452.385707:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533800704 00000100:00100000:3.0:1789265452.385781:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:3.0:1789265452.385792:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:10290:x1876180533800704:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265452.385816:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265452.385839:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818f785 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f844a expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.385939:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f78c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.385966:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.385979:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265452.386017:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789265452.386021:0:9387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265452.386040:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.386067:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818f785 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f844a expref: 18 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.386088:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f844a expref: 17 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.386096:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:3.0:1789265452.386099:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265452.386102:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:3.0:1789265452.386175:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:10290:x1876180533800704:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 385us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265452.386183:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:1.0:1789265452.394184:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265452.394302:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533800960 00000100:00100000:0.0:1789265452.394314:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533800960 00000100:00100000:0.0:1789265452.394419:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1789265452.394430:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:10290:x1876180533800960:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265452.394453:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265452.394477:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef818f793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8451 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.394593:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818f79a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.394607:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818f79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.394619:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818f79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265452.394631:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789265452.394979:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef818f793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8451 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.394999:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818f79a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8451 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.395008:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3b00) 00010000:00010000:0.0:1789265452.395011:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265452.395029:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995200, rc 0) 00000100:00100000:0.0:1789265452.395137:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10290:x1876180533800960:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 707us (962us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789265452.395145:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1789265452.401896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265452.402057:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265452.402136:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533801344 00000100:00100000:1.0:1789265452.402147:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533801344 00000100:00100000:1.0:1789265452.402207:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:1.0:1789265452.402217:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10290:x1876180533801344:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265452.402243:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265452.402265:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f7a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8458 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.402486:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f7af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.402511:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f7af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.402524:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f7af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265452.402537:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789265452.402660:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f7a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8458 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.402680:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f7af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8458 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.402884:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3b00) 00010000:00010000:1.0:1789265452.402888:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789265452.402891:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f000, rc 0) 00000100:00100000:1.0:1789265452.403090:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10290:x1876180533801344:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 872us (1031us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789265452.403099:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:2.0:1789265452.403522:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533801088 00000100:00100000:2.0:1789265452.403543:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533801088 00000100:00100000:2.0:1789265452.403642:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:2.0:1789265452.403651:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:2345:x1876180533801088:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265452.403666:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265452.403705:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818f79a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8451 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.403721:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3b00) 00010000:00010000:2.0:1789265452.403725:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265452.403756:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:2345:x1876180533801088:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 107us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265452.403763:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:3.0:1789265452.414574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265452.416179:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533801472 00000100:00100000:0.0:1789265452.416196:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533801472 00000100:00100000:0.0:1789265452.416262:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:0.0:1789265452.416273:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533801472:12345-192.168.204.43@tcp:1:lfs.0 00010000:00010000:0.0:1789265452.416321:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.416360:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.416370:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265452.416375:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265452.416388:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.416432:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.416446:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 7 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265452.416482:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1876180553758208:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265452.416590:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff925402b416c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265452.431420:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1876180553758208:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265452.431452:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265452.432559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265452.432947:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533801600 00000100:00100000:0.0:1789265452.432959:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533801600 00002000:00100000:0.0:1789265452.433007:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff925437005500 x1876180533801600/t0(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:23/0 lens 504/0 e 0 to 0 dl 1789265463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265452.433019:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925437005500 with x1876180533801600 ext(0->12) 00010000:00010000:0.0:1789265452.433029:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 8 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.433045:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 8 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265452.433053:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff925437005500 00000100:00100000:0.0:1789265452.433095:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:0.0:1789265452.433105:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533801600:12345-192.168.204.43@tcp:4:lfs.0 00000100:00100000:3.0:1789265452.447532:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553758336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265452.447608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265452.449108:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553758336 00000100:00100000:2.0:1789265452.449122:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553758336 00000100:00100000:2.0:1789265452.449187:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265452.449196:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553758336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265452.449226:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265452.449303:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553758336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265452.449310:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265452.451180:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553758336:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789265452.507970:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000100:00100000:3.0:1789265452.508863:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2342:x1876180533801600:12345-192.168.204.43@tcp:4:lfs.0 Request processed in 75752us (76302us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789265452.508883:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00002000:00100000:3.0:1789265452.508898:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff925437005500 x1876180533801600/t4294967299(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:23/0 lens 504/448 e 0 to 0 dl 1789265463 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265452.508911:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925437005500 with x1876180533801600 ext(0->12) 00010000:00010000:3.0:1789265452.508922:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 9 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.508942:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 9 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265452.508952:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff925437005500 00000100:00100000:0.0:1789265452.520183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265452.520540:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533801728 00000100:00100000:1.0:1789265452.520551:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533801728 00010000:00010000:1.0:1789265452.520598:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 9 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265452.520708:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:1.0:1789265452.520719:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2344:x1876180533801728:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265452.520735:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789265452.520763:0:11653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789265452.520767:0:11653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789265451 00002000:00010000:1.0:1789265452.520770:0:11653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789265451 00002000:00010000:1.0:1789265452.520772:0:11653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789265451 00010000:00010000:1.0:1789265452.520778:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 9 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.520795:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 9 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.520822:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f3713f/0x8e12577ef818f770 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f843c expref: 9 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.520843:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265452.520848:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265452.520854:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.520864:0:11653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.520919:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265452.520989:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2344:x1876180533801728:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 271us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265452.520996:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00010000:00010000:0.0:1789265452.521292:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.521303:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.521372:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.522424:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.522438:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.522445:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995e00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265452.522450:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.522460:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.522478:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.522486:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b81d6f4/0x8e12577ef818f7bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265452.522589:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533801472:12345-192.168.204.43@tcp:1:lfs.0 Request processed in 106314us (108021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265452.522599:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:0.0:1789265452.527964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265452.528545:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533801984 00000100:00100000:3.0:1789265452.528563:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533801984 00000100:00100000:3.0:1789265452.528649:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:3.0:1789265452.528660:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:10290:x1876180533801984:12345-192.168.204.43@tcp:35:lfs.0 00000004:00010000:3.0:1789265452.528726:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f7af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8458 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265452.529018:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789265452.529065:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789265452.529733:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1789265452.529802:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.529820:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 24 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.529829:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.529869:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 24 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265452.529885:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 24 pid: 9387 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265452.529901:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437005880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1876180553758464:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265452.529984:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cb80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265452.535917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265452.536018:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533802112 00000100:00100000:2.0:1789265452.536028:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533802112 00010000:00010000:2.0:1789265452.536069:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 25 pid: 9387 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265452.536118:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:2.0:1789265452.536127:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:2343:x1876180533802112:12345-192.168.204.43@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789265452.536148:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437005880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1876180553758464:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265452.536160:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265452.536166:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 25 pid: 9387 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.536177:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 25 pid: 9387 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.537470:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.537560:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f842e expref: 25 pid: 9387 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.537580:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3b00) 00010000:00010000:2.0:1789265452.537585:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.537595:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.537603:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.537635:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265452.537708:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:2343:x1876180533802112:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1581us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265452.537717:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00010000:00010000:0.0:1789265452.537780:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.537786:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265452.537920:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789265452.538215:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789265452.538725:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1876180553758592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789265452.538838:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265452.538911:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a487240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265452.538960:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553758592 00000100:00100000:1.0:1789265452.538968:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553758592 00000100:00100000:1.0:1789265452.539110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265452.539120:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1876180553758592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265452.539240:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1876180553758592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265452.539247:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265452.539704:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1876180553758592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789265452.540821:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789265452.540904:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1876180553758720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789265452.540975:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265452.541083:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a4870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265452.541195:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553758720 00000100:00100000:1.0:1789265452.541202:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553758720 00000100:00100000:1.0:1789265452.541302:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265452.541312:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1876180553758720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265452.541562:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1876180553758720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 251us (587us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789265452.541571:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265452.541734:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1876180553758720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789265452.541789:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1789265452.541830:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.541841:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.541849:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.541871:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265452.541877:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.541885:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.541900:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3b00) 00010000:00010000:0.0:1789265452.541904:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789265452.541909:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265452.541914:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818f7c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265452.542376:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789265452.542624:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789265452.542637:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307776304255ns, next at 308776301358ns, rc = 0 00000001:00080000:0.0:1789265452.542646:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789265452.542684:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3b00) 00010000:00010000:0.0:1789265452.542688:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789265452.542696:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f7af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8458 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265452.542819:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:10290:x1876180533801984:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 14160us (14864us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789265452.542828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000020:00080000:0.0:1789265452.542832:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789265452.548161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265452.548279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533802240 00000100:00100000:1.0:1789265452.548290:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533802240 00000100:00100000:1.0:1789265452.548451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:1.0:1789265452.548463:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:10290:x1876180533802240:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265452.548489:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265452.548524:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f7cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f845f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.548610:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f7cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f845f expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.548626:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f7cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f845f expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.548652:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265452.548656:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265452.548660:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f200, rc 0) 00000100:00100000:1.0:1789265452.548799:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:10290:x1876180533802240:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 338us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265452.548807:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:2.0:1789265452.553761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265452.554840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533802496 00000100:00100000:1.0:1789265452.554851:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533802496 00000100:00100000:1.0:1789265452.554914:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1789265452.554925:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:10290:x1876180533802496:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1789265452.555228:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10290:x1876180533802496:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 303us (1475us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789265452.555236:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00010000:00010000:2.0:1789265452.576982:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265452.659577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265452.659960:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533802752 00000100:00100000:1.0:1789265452.659971:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533802752 00000100:00100000:1.0:1789265452.660100:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:1.0:1789265452.660111:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10300:x1876180533802752:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265452.660136:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265452.660156:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f7d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8466 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265452.660266:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789265452.660420:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f7d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8466 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.660435:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:1.0:1789265452.660438:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265452.660443:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f7d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8466 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.660458:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5ec00, rc 0) 00000100:00100000:1.0:1789265452.660536:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10300:x1876180533802752:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 426us (968us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1789265452.660543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:3.0:1789265452.669484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265452.669839:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533802880 00000100:00100000:2.0:1789265452.669849:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533802880 00000100:00100000:2.0:1789265452.669923:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:2.0:1789265452.669962:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10300:x1876180533802880:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:2.0:1789265452.670047:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670065:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670078:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670092:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670098:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670103:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670197:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670367:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670378:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265452.670431:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670443:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670459:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670660:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670668:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265452.670672:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670680:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670694:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265452.670697:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265452.670701:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670707:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f7e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670722:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670728:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670733:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670738:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265452.670748:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670755:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670763:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540ccf3900) 00010000:00010000:2.0:1789265452.670766:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265452.670769:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670774:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818f7e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670792:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670797:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670803:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670808:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265452.670810:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670816:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670822:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:2.0:1789265452.670824:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265452.670833:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265452.670838:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f7ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265452.670935:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10300:x1876180533802880:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 983us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265452.672491:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:2.0:1789265452.681777:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265452.682137:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533803136 00000100:00100000:0.0:1789265452.682147:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533803136 00000100:00100000:0.0:1789265452.682211:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1789265452.682221:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10300:x1876180533803136:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265452.682798:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10300:x1876180533803136:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 576us (1030us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789265452.682806:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1789265452.758638:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265452.758833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533803392 00000100:00100000:1.0:1789265452.758844:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533803392 00000100:00100000:1.0:1789265452.758906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:1.0:1789265452.758915:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10303:x1876180533803392:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265452.758951:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265452.758974:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f7f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f846d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759061:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759077:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759112:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759128:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759136:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759142:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759276:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759284:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759292:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265452.759303:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789265452.759463:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759471:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759478:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759484:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265452.759511:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759519:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759532:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265452.759535:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265452.759539:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759545:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f7fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759559:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759565:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759571:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759576:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265452.759579:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759584:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759590:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540cd7ae00) 00010000:00010000:1.0:1789265452.759592:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265452.759600:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759605:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759648:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f7f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759661:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.759667:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265452.759669:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265452.759672:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f000, rc 0) 00000100:00100000:1.0:1789265452.760716:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10303:x1876180533803392:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1793us (2079us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789265452.760726:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:3.0:1789265452.769776:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265452.770185:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533803520 00000100:00100000:1.0:1789265452.770196:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533803520 00000100:00100000:1.0:1789265452.770264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:1.0:1789265452.770275:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10303:x1876180533803520:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:1.0:1789265452.770374:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770391:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770407:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770455:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770463:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770469:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770475:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265452.770479:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770486:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770510:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265452.770513:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265452.770518:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265452.770524:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818f818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265452.770614:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10303:x1876180533803520:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 341us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265452.770622:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:3.0:1789265452.779915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265452.780059:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533803776 00000100:00100000:1.0:1789265452.780070:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533803776 00000100:00100000:1.0:1789265452.780134:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:1.0:1789265452.780160:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10303:x1876180533803776:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1789265452.780478:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:10303:x1876180533803776:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 319us (573us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789265452.780485:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000001:00080000:3.0:1789265453.077294:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967328 is committed 00000004:00080000:3.0:1789265453.077311:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789265453.077385:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92540a487240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789265453.077391:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925437731100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92540a487300 00000020:00080000:3.0:1789265453.077394:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925437731600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92544167c400 00000100:00100000:3.0:1789265453.077729:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553758848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265453.077812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265453.077941:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553758848 00000100:00100000:1.0:1789265453.077950:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553758848 00000100:00100000:1.0:1789265453.078021:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265453.078031:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553758848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789265453.078070:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789265453.078107:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa6062b, atime: 0x6aa6062b, ctime: 0x6aa6062b, blocks: 0x1 00010000:00010000:1.0:1789265453.078115:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078131:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1789265453.078135:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265453.078142:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078158:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078168:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078176:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078206:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265453.078770:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876180553758848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 738us (955us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265453.078779:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789265453.078813:0:11651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265453.078820:0:11651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078829:0:11651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265453.078833:0:11651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078843:0:11651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078863:0:11651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078870:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818f81f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.078887:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265453.078889:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265453.078891:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265453.079531:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789265453.079579:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff925402c48380/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789265453.079588:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553758848:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1789265453.079790:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789265453.079905:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000001:00080000:3.0:1789265453.079950:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000100:00100000:2.0:1789265453.186044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265453.186272:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533804032 00000100:00100000:3.0:1789265453.186285:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533804032 00000100:00100000:3.0:1789265453.186455:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:3.0:1789265453.186467:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:10334:x1876180533804032:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:3.0:1789265453.186505:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265453.186527:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818f826 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8474 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.186636:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f82d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.186651:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.186664:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265453.186676:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789265453.187595:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818f826 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8474 expref: 15 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.187617:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8474 expref: 14 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.187642:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:3.0:1789265453.187646:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265453.187649:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884600, rc 0) 00000100:00100000:3.0:1789265453.188137:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10334:x1876180533804032:12345-192.168.204.43@tcp:101:cat.0 Request processed in 1671us (2100us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789265453.188145:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00080000:0.0:1789265453.190296:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265453.193673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265453.195188:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533804160 00000100:00100000:2.0:1789265453.195203:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533804160 00000100:00100000:2.0:1789265453.195300:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:2.0:1789265453.195310:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2344:x1876180533804160:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265453.195328:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265453.195415:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818f82d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8474 expref: 14 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.195439:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:2.0:1789265453.195444:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265453.195526:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:2344:x1876180533804160:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 217us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265453.195534:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:3.0:1789265453.196693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265453.196958:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533804416 00000100:00100000:1.0:1789265453.196969:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533804416 00000100:00100000:1.0:1789265453.197033:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:1.0:1789265453.197042:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:10334:x1876180533804416:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:1.0:1789265453.197299:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10334:x1876180533804416:12345-192.168.204.43@tcp:35:cat.0 Request processed in 257us (621us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789265453.197309:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:3.0:1789265453.304880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265453.305122:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533804672 00000100:00100000:0.0:1789265453.305135:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533804672 00000100:00100000:0.0:1789265453.305204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:0.0:1789265453.305215:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10340:x1876180533804672:12345-192.168.204.43@tcp:101:dd.0 00010000:00010000:0.0:1789265453.305245:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265453.305249:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789265453.305281:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818f78c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f844a expref: 14 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.305304:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:0.0:1789265453.305309:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265453.305324:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f83b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f847b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.305501:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.305514:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.305536:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.305570:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.305585:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 14 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265453.305599:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553758976:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265453.305688:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254030219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265453.309299:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553758976:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265453.309375:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265453.314874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265453.315421:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533804800 00000100:00100000:2.0:1789265453.315431:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533804800 00010000:00010000:2.0:1789265453.315474:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 15 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265453.315553:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:2.0:1789265453.315565:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:2343:x1876180533804800:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265453.315582:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265453.315589:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 15 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.315603:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 15 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.315626:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818f80a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f846d expref: 15 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.315644:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:2.0:1789265453.315651:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.315661:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.315668:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.315712:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265453.315778:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2343:x1876180533804800:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 215us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265453.315786:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00010000:00010000:0.0:1789265453.316296:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.316308:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265453.316382:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789265453.316592:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f83b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.316612:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.316637:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:0.0:1789265453.316640:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265453.316643:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995600, rc 0) 00000100:00100000:0.0:1789265453.316691:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10340:x1876180533804672:12345-192.168.204.43@tcp:101:dd.0 Request processed in 11478us (11823us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789265453.316699:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:3.0:1789265453.321143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265453.321231:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533805056 00000100:00100000:0.0:1789265453.321242:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533805056 00000100:00100000:0.0:1789265453.321313:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:0.0:1789265453.321324:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10340:x1876180533805056:12345-192.168.204.43@tcp:36:dd.0 00010000:00010000:0.0:1789265453.321707:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.321727:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.321739:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265453.321792:0:9189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789265453.321818:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000240ff287 reply state 00000000d21b19a2 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265453.321828:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265453.321927:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:10340:x1876180533805056:12345-192.168.204.43@tcp:36:dd.0 Request processed in 603us (792us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789265453.321936:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00000020:00080000:0.0:1789265453.321953:0:9189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265453.327502:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.327535:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.327544:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.327551:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265453.327556:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.327565:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.327584:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:3.0:1789265453.327604:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265453.327610:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.327617:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f850 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265453.558598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265453.558871:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533805184 00000100:00100000:2.0:1789265453.558898:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533805184 00000100:00100000:2.0:1789265453.558976:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:2.0:1789265453.558987:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:10354:x1876180533805184:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:2.0:1789265453.559018:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265453.559038:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8482 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559102:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559117:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559129:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559144:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559152:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559158:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559556:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559570:0:9387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559578:0:9387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559621:0:9387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.559636:0:9387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 17 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265453.559649:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553759104:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265453.559762:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a5c6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265453.568196:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265453.568310:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533805440 00000100:00100000:1.0:1789265453.568321:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533805440 00000100:00100000:1.0:1789265453.568422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1789265453.568645:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:5585:x1876180533805440:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265453.569158:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:5585:x1876180533805440:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 519us (972us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789265453.569168:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:2.0:1789265453.571646:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553759104:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265453.571684:0:9387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265453.572623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265453.575650:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533805568 00000100:00100000:2.0:1789265453.575672:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533805568 00010000:00010000:2.0:1789265453.575747:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 19 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265453.575826:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:2.0:1789265453.575838:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:2342:x1876180533805568:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265453.575857:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265453.575866:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 19 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.575880:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 19 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.576141:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f842 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f847b expref: 19 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.576165:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:2.0:1789265453.576172:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.576183:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.576190:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265453.576228:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265453.576296:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:2342:x1876180533805568:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 460us (3678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265453.576303:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00010000:00010000:3.0:1789265453.576558:0:9387:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576567:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265453.576616:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789265453.576621:0:9387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265453.576666:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576678:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576687:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576695:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576701:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576718:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265453.576723:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576731:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576743:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:3.0:1789265453.576745:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265453.576749:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576755:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818f85e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576768:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576774:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576779:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576797:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265453.576800:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576806:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576826:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540ccf3700) 00010000:00010000:3.0:1789265453.576828:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265453.576831:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576837:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576882:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8482 expref: 18 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576896:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8482 expref: 17 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.576904:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:3.0:1789265453.576907:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265453.576909:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137200, rc 0) 00000100:00100000:3.0:1789265453.577095:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:10354:x1876180533805184:12345-192.168.204.43@tcp:101:stat.0 Request processed in 18109us (18508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265453.577104:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00010000:00010000:2.0:1789265453.599744:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265453.670921:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265453.671425:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533805824 00000100:00100000:0.0:1789265453.671437:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533805824 00000100:00100000:0.0:1789265453.671526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:0.0:1789265453.671537:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:10360:x1876180533805824:12345-192.168.204.43@tcp:36:truncate.0 00010000:00010000:0.0:1789265453.671624:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265453.671654:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f86c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8482 expref: 17 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.671678:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:0.0:1789265453.671683:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265453.671955:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.671970:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265453.671981:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265453.672034:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789265453.672060:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e1c4b82 reply state 000000003e997e80 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265453.672070:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265453.673092:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10360:x1876180533805824:12345-192.168.204.43@tcp:36:truncate.0 Request processed in 1549us (2175us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789265453.673102:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00000020:00080000:0.0:1789265453.673109:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265453.678700:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.678721:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.678729:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.678754:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265453.678759:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.678767:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.678785:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:3.0:1789265453.678789:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265453.678794:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.678800:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f873 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265453.808877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265453.809003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533805952 00000100:00100000:1.0:1789265453.809018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533805952 00000100:00100000:1.0:1789265453.809148:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:1.0:1789265453.809169:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:10374:x1876180533805952:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:1.0:1789265453.809194:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265453.809216:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f87a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8489 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.809278:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.809293:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.809306:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.809337:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.809380:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.809388:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811623:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811641:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811653:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265453.811699:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789265453.811704:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265453.811806:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811820:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811829:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811835:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811854:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811860:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265453.811864:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811872:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811885:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265453.811888:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265453.811892:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811898:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f881 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811913:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811919:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811925:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811931:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265453.811934:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811950:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811972:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540cd7ae00) 00010000:00010000:1.0:1789265453.811975:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265453.811978:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.811985:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818f888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.812028:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818f87a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.812043:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265453.812051:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265453.812053:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265453.812055:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5fc00, rc 0) 00000100:00100000:1.0:1789265453.812145:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10374:x1876180533805952:12345-192.168.204.43@tcp:101:stat.0 Request processed in 2986us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265453.813326:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:0.0:1789265453.909215:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265453.909443:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533806208 00000100:00100000:3.0:1789265453.909454:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533806208 00000100:00100000:3.0:1789265453.909524:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:3.0:1789265453.909534:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10384:x1876180533806208:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265453.909553:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265453.909572:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818f896 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8490 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265453.909659:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789265453.909796:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818f896 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8490 expref: 21 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.909811:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:3.0:1789265453.909822:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265453.909828:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818f896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8490 expref: 21 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265453.909844:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884400, rc 0) 00000100:00100000:3.0:1789265453.909925:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:10384:x1876180533806208:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 393us (722us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789265453.909932:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:3.0:1789265453.917949:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265453.919234:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533806464 00000100:00100000:0.0:1789265453.919251:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533806464 00000100:00100000:0.0:1789265453.919395:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:0.0:1789265453.919407:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:10384:x1876180533806464:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265453.923006:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10384:x1876180533806464:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 3588us (5082us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789265453.923024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1789265454.017670:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265454.017803:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533806720 00000100:00100000:2.0:1789265454.017819:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533806720 00000100:00100000:2.0:1789265454.017904:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:2.0:1789265454.017933:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10390:x1876180533806720:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265454.017965:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265454.017993:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f8a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8497 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.018145:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.018198:0:9189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.018209:0:9189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.018254:0:9189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.018271:0:9189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 22 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265454.018286:0:9189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553759232:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265454.018634:0:9189:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a5c6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265454.023842:0:9189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553759232:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265454.023888:0:9189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265454.030031:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265454.030737:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533806848 00000100:00100000:2.0:1789265454.030753:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533806848 00010000:00010000:2.0:1789265454.030811:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 23 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265454.030862:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:2.0:1789265454.030875:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:2343:x1876180533806848:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265454.030895:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265454.030933:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 23 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.030950:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 23 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.030980:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818f88f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8489 expref: 23 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.030999:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:2.0:1789265454.031005:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.031015:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.031024:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.031064:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265454.031149:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:2343:x1876180533806848:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 276us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265454.031158:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00010000:00010000:0.0:1789265454.031286:0:9189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.031296:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265454.031322:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789265454.031607:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f8a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 23 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.031626:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 22 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.031634:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:0.0:1789265454.031637:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265454.031640:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137e00, rc 0) 00000100:00100000:0.0:1789265454.031672:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:10390:x1876180533806720:12345-192.168.204.43@tcp:101:bash.0 Request processed in 13760us (14023us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789265454.031681:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:3.0:1789265454.035087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265454.035197:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533807104 00000100:00100000:1.0:1789265454.035211:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533807104 00000100:00100000:1.0:1789265454.035286:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:1.0:1789265454.035309:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:10390:x1876180533807104:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:1.0:1789265454.035718:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.035740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.035753:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265454.035818:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1789265454.035846:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d851fad8 reply state 000000007b34f8a8 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265454.035857:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265454.035978:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:10390:x1876180533807104:12345-192.168.204.43@tcp:36:bash.0 Request processed in 670us (906us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789265454.035986:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00000020:00080000:1.0:1789265454.035993:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265454.040987:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265454.041011:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265454.041021:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265454.041028:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265454.041034:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265454.041044:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265454.041068:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:3.0:1789265454.041072:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265454.041078:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265454.041112:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818f8b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265454.046668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.047084:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533807232 00000100:00100000:0.0:1789265454.047101:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533807232 00000100:00100000:0.0:1789265454.047207:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:0.0:1789265454.047218:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:10390:x1876180533807232:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265454.047251:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265454.047281:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f8c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f849e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.047418:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.047435:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 25 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.047445:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.047503:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 25 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.047518:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 25 pid: 9189 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265454.047535:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553759360:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265454.047654:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403021d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265454.050222:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553759360:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265454.050263:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265454.051080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265454.051381:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533807360 00000100:00100000:2.0:1789265454.051399:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533807360 00010000:00010000:2.0:1789265454.051448:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 26 pid: 9189 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265454.051548:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:2.0:1789265454.051560:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437009180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:2342:x1876180533807360:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265454.051595:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265454.051602:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 26 pid: 9189 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.051617:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 26 pid: 9189 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.051646:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818f8ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8497 expref: 26 pid: 9189 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.051666:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:2.0:1789265454.051672:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.051683:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.051691:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.051715:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265454.051784:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437009180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:2342:x1876180533807360:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 226us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265454.051792:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00010000:00010000:0.0:1789265454.052418:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.052437:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265454.052514:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789265454.052520:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265454.052549:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.052592:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f8c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f849e expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.052613:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f849e expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.052622:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:0.0:1789265454.052625:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265454.052629:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995c00, rc 0) 00000100:00100000:0.0:1789265454.052691:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:10390:x1876180533807232:12345-192.168.204.43@tcp:101:bash.0 Request processed in 5474us (6043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265454.052699:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:3.0:1789265454.056948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.057218:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533807616 00000100:00100000:0.0:1789265454.057231:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533807616 00000100:00100000:0.0:1789265454.057299:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1789265454.057311:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:10390:x1876180533807616:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:0.0:1789265454.057678:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:10390:x1876180533807616:12345-192.168.204.43@tcp:35:bash.0 Request processed in 368us (744us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789265454.057698:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:3.0:1789265454.133578:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.133716:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533807872 00000100:00100000:0.0:1789265454.133732:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533807872 00000100:00100000:0.0:1789265454.133874:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:0.0:1789265454.133887:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:10400:x1876180533807872:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265454.133939:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265454.133969:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f8ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84a5 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265454.134096:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789265454.134447:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f8ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84a5 expref: 27 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.134477:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:0.0:1789265454.134482:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265454.134488:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84a5 expref: 27 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.134506:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994000, rc 0) 00000100:00100000:0.0:1789265454.134589:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:10400:x1876180533807872:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 705us (1028us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789265454.134601:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:3.0:1789265454.136992:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.137542:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533808000 00000100:00100000:0.0:1789265454.137558:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533808000 00000100:00100000:0.0:1789265454.137639:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:0.0:1789265454.137652:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:10400:x1876180533808000:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:0.0:1789265454.137768:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.137812:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.137828:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.137848:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.137856:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.137864:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.138885:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.138901:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.138975:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265454.139042:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139060:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139068:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139089:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139097:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265454.139102:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139180:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139198:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:0.0:1789265454.139202:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265454.139209:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139216:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139231:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139238:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139245:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139250:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265454.139253:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139270:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139279:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92542b074700) 00010000:00010000:0.0:1789265454.139282:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265454.139285:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139292:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139309:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139317:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139323:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139329:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265454.139785:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139793:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139802:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:0.0:1789265454.139805:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265454.139809:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.139827:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265454.139963:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:10400:x1876180533808000:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 2306us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265454.139974:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:3.0:1789265454.142372:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.142530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533808256 00000100:00100000:0.0:1789265454.142546:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533808256 00000100:00100000:0.0:1789265454.142621:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:0.0:1789265454.142635:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:10400:x1876180533808256:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265454.142956:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:10400:x1876180533808256:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 323us (629us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789265454.142965:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1789265454.173653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.173934:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533808512 00000100:00100000:0.0:1789265454.173949:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533808512 00000100:00100000:0.0:1789265454.174028:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:0.0:1789265454.174051:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:10403:x1876180533808512:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265454.174598:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265454.174631:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.174742:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.174759:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.174794:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.174811:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.174818:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.174825:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.177784:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.177813:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.177830:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265454.177847:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789265454.177977:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.177987:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.177996:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.178003:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265454.178018:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.178028:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.178044:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:0.0:1789265454.178048:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265454.178054:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.178062:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f8f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.178078:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.178085:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.178092:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.178099:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265454.178102:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.179289:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.179306:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92542b074700) 00010000:00010000:0.0:1789265454.179309:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265454.179324:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.179591:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f8ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.179710:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f8f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84ac expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.179730:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84ac expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.179739:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:0.0:1789265454.179741:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265454.179744:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994000, rc 0) 00000100:00100000:0.0:1789265454.179868:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10403:x1876180533808512:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 5819us (6235us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789265454.179879:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:3.0:1789265454.184909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265454.184973:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.185079:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533808768 00000100:00100000:0.0:1789265454.185101:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533808768 00000100:00100000:2.0:1789265454.185205:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533808640 00000100:00100000:2.0:1789265454.185211:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533808640 00000100:00100000:2.0:1789265454.185295:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:2.0:1789265454.185310:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:2345:x1876180533808640:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265454.185379:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265454.185432:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818f906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84ac expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.185456:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:2.0:1789265454.185473:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265454.185546:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:2345:x1876180533808640:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 239us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265454.185555:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:1.0:1789265454.185579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:1.0:1789265454.185592:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:10403:x1876180533808768:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:1.0:1789265454.185668:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185685:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185699:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185730:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185744:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185751:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185757:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ee00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265454.185761:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185769:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185778:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265454.185780:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265454.185784:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.185789:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265454.185854:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:10403:x1876180533808768:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 265us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265454.185861:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:3.0:1789265454.195836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.198004:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533809024 00000100:00100000:0.0:1789265454.198094:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533809024 00000100:00100000:0.0:1789265454.198258:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:0.0:1789265454.198271:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:10403:x1876180533809024:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265454.198706:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10403:x1876180533809024:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 437us (2883us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789265454.198714:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1789265454.370134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.372867:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533809280 00000100:00100000:0.0:1789265454.372888:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533809280 00000100:00100000:0.0:1789265454.373003:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:0.0:1789265454.373029:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10421:x1876180533809280:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:0.0:1789265454.373063:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265454.373091:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f91b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84b3 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.373234:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f922 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.373253:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.373269:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265454.373282:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789265454.373516:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f91b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84b3 expref: 32 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.373538:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f922 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84b3 expref: 31 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.373558:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:0.0:1789265454.373562:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789265454.373567:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995000, rc 0) 00000100:00100000:0.0:1789265454.373662:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10421:x1876180533809280:12345-192.168.204.43@tcp:101:cat.0 Request processed in 647us (3545us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789265454.373670:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:2.0:1789265454.401175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.401261:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533809408 00000100:00100000:0.0:1789265454.401289:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533809408 00000100:00100000:2.0:1789265454.401674:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:2.0:1789265454.401690:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10422:x1876180533809408:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265454.401720:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265454.401749:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84ba expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.401909:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.401927:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.401941:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265454.402001:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789265454.402006:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265454.402955:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.403004:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84ba expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.403027:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84ba expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265454.403448:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265454.403452:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265454.403457:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137a00, rc 0) 00000100:00100000:2.0:1789265454.403567:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10422:x1876180533809408:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1881us (2407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265454.403576:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:3.0:1789265454.413291:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265454.414012:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533809792 00000100:00100000:1.0:1789265454.414153:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533809792 00000100:00100000:1.0:1789265454.414685:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:1.0:1789265454.414701:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10422:x1876180533809792:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1789265454.415189:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10422:x1876180533809792:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 489us (1912us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789265454.415216:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:3.0:1789265454.418422:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265454.418668:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533809920 00000100:00100000:1.0:1789265454.418681:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533809920 00000100:00100000:1.0:1789265454.418768:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:1.0:1789265454.418780:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10422:x1876180533809920:12345-192.168.204.43@tcp:103:lfs.0 00010000:00010000:1.0:1789265454.418799:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789265454.418839:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818f8c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f849e expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.418868:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818f922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84b3 expref: 32 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.418881:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818f7cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f845f expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265454.418892:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265454.418904:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265454.419409:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10422:x1876180533809920:12345-192.168.204.43@tcp:103:lfs.0 Request processed in 628us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265454.419419:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:2.0:1789265454.423526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.423610:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533810048 00000100:00100000:0.0:1789265454.423623:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533810048 00000100:00100000:0.0:1789265454.423739:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:0.0:1789265454.423753:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10422:x1876180533810048:12345-192.168.204.43@tcp:58:lfs.0 00010000:00010000:0.0:1789265454.424150:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.424172:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.424187:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265454.425641:0:9189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265454.425894:0:9189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789265454.425973:0:9189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789265454.426131:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10422:x1876180533810048:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 2374us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265454.426143:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:3.0:1789265454.479508:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265454.479633:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533810176 00000100:00100000:0.0:1789265454.479643:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533810176 00000100:00100000:0.0:1789265454.479713:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:0.0:1789265454.479723:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10424:x1876180533810176:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265454.479744:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265454.479766:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84c1 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.479836:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480011:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480024:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480042:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480050:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480057:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480298:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480309:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480317:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265454.480393:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789265454.480398:0:9387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265454.480421:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480435:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480454:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480471:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480478:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480484:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265454.480488:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480495:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480509:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:0.0:1789265454.480512:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265454.480516:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480523:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f94c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480538:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480544:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480550:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480561:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265454.480565:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480571:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480579:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92542b074800) 00010000:00010000:0.0:1789265454.480582:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265454.480584:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480591:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480629:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818f945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 32 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480643:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 31 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265454.480651:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265454.480653:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265454.480655:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994600, rc 0) 00000100:00100000:0.0:1789265454.480726:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10424:x1876180533810176:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1004us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265454.480734:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:3.0:1789265454.498638:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265454.498666:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553759488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265454.498746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265454.499022:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553759488 00000100:00100000:0.0:1789265454.499047:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553759488 00000100:00100000:0.0:1789265454.499131:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265454.499141:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553759488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265454.499179:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265454.499228:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553759488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265454.499235:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789265454.499347:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265454.499387:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553759488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265454.623860:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265454.709150:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265454.709207:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265454.709281:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533810304 00000100:00100000:1.0:1789265454.709297:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533810304 00000100:00100000:1.0:1789265454.709401:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 286 00000100:00100000:1.0:1789265454.709414:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533810304:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265454.709521:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533810304:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 109us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265454.709551:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 286 00000100:00100000:0.0:1789265454.710372:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533810432 00000100:00100000:0.0:1789265454.710382:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533810432 00000100:00100000:0.0:1789265454.710440:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:0.0:1789265454.710451:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2344:x1876180533810432:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265454.710519:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2344:x1876180533810432:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 71us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265454.710527:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00080000:3.0:1789265454.712036:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265454.726136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265454.726194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533810560 00000100:00100000:2.0:1789265454.726207:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533810560 00000100:00100000:2.0:1789265454.726314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 127 00000100:00100000:2.0:1789265454.726328:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533810560:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265454.726449:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533810560:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 125us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265454.726468:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 127 00000100:00080000:0.0:1789265454.728860:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789265455.262748:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265455.262760:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265455.262825:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789265455.262841:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265455.263117:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437008a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553759616:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265455.263259:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c0c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265455.275125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.277391:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437008a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553759616:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265455.277825:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533810688 00000100:00100000:1.0:1789265455.277837:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533810688 00000100:00100000:1.0:1789265455.277947:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:1.0:1789265455.277961:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10435:x1876180533810688:12345-192.168.204.43@tcp:900:lhsmtool_posix.0 00000100:00080000:3.0:1789265455.281544:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265455.283268:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10435:x1876180533810688:12345-192.168.204.43@tcp:900:lhsmtool_posix.0 Request processed in 5292us (8140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265455.283288:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:0.0:1789265455.290651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.290744:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533810816 00000100:00100000:3.0:1789265455.290758:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533810816 00000100:00100000:3.0:1789265455.290839:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:3.0:1789265455.290852:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10435:x1876180533810816:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265455.290899:0:9189:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265455.291052:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10435:x1876180533810816:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 203us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.291061:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:3.0:1789265455.298077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265455.298172:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533810944 00000100:00100000:1.0:1789265455.298186:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533810944 00000100:00100000:1.0:1789265455.298268:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:1.0:1789265455.298282:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10435:x1876180533810944:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789265455.298453:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298476:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298495:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298516:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298525:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298532:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298582:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298592:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298600:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265455.298656:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789265455.298661:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265455.298678:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298691:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298699:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298707:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298715:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ee00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265455.298719:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298728:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298743:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:1.0:1789265455.298751:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265455.298758:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298765:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f961 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298780:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298788:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298793:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298799:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265455.298801:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298807:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298813:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265455.298816:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265455.298818:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298823:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f968 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298838:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298850:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298855:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298860:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265455.298863:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298869:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298877:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074700) 00010000:00010000:1.0:1789265455.298879:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265455.298882:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.298886:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818f96f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265455.298985:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10435:x1876180533810944:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 704us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265455.298995:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:3.0:1789265455.307679:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.307824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533811200 00000100:00100000:2.0:1789265455.307837:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533811200 00000100:00100000:2.0:1789265455.307916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:2.0:1789265455.307942:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10435:x1876180533811200:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265455.307972:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265455.308001:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f976 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84c8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308141:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308158:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308172:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265455.308185:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789265455.308313:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308322:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308356:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308364:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265455.308369:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308378:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308393:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265455.308403:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265455.308424:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308432:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f97d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308496:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f976 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c8 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308508:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:2.0:1789265455.308511:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265455.308515:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f976 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c8 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.308526:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137200, rc 0) 00000100:00100000:2.0:1789265455.308613:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10435:x1876180533811200:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 673us (947us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789265455.308621:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:1.0:1789265455.316504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265455.316696:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533811328 00000100:00100000:0.0:1789265455.316711:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533811328 00000100:00100000:0.0:1789265455.316784:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:0.0:1789265455.316797:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10435:x1876180533811328:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265455.316846:0:9387:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265455.316999:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10435:x1876180533811328:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 204us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265455.317008:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:0.0:1789265455.323007:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265455.323062:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533811584 00000100:00100000:0.0:1789265455.323092:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533811584 00000100:00100000:0.0:1789265455.323173:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:0.0:1789265455.323185:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10435:x1876180533811584:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265455.323211:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265455.323215:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789265455.323249:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818f937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84ba expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.323273:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:0.0:1789265455.323280:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265455.323299:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f98b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84cf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265455.324177:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789265455.324548:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.324566:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.324580:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.324657:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f98b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84cf expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.324678:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84cf expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.324699:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92542b074000) 00010000:00010000:0.0:1789265455.324703:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265455.324706:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995600, rc 0) 00000100:00100000:0.0:1789265455.324811:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10435:x1876180533811584:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1627us (1819us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789265455.324821:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:3.0:1789265455.334625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265455.334799:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533811840 00000100:00100000:1.0:1789265455.334814:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533811840 00000100:00100000:1.0:1789265455.334891:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:1.0:1789265455.334903:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10435:x1876180533811840:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265455.334992:0:9189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265455.335025:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818f992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84cf expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.335046:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92542b074000) 00010000:00010000:1.0:1789265455.335060:0:9189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265455.335089:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.335107:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.335120:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.335136:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.335144:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.335171:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336358:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336375:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336383:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336399:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265455.336404:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336426:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336454:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265455.336457:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265455.336464:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336470:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818f9a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336484:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336490:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336497:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336503:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ee00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265455.336506:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336513:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336532:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc0eb6a85 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265455.336535:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265455.336538:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.336545:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc0eb6a85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265455.336688:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10435:x1876180533811840:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 1781us (2073us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265455.336701:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:1.0:1789265455.348661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.349585:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533811968 00000100:00100000:2.0:1789265455.349603:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533811968 00000100:00100000:2.0:1789265455.349675:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:2.0:1789265455.349686:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10435:x1876180533811968:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265455.349715:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265455.349745:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f9ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.349793:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.349819:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.349834:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.349973:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818f9ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.349993:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.350003:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265455.350007:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265455.350011:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137800, rc 0) 00000100:00100000:2.0:1789265455.350094:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10435:x1876180533811968:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 410us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265455.350102:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:2.0:1789265455.357641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.357732:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533812224 00000100:00100000:3.0:1789265455.357747:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533812224 00000100:00100000:3.0:1789265455.357826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:3.0:1789265455.357840:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10435:x1876180533812224:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265455.357962:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.357986:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.358001:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265455.358439:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789265455.358464:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310592131395ns, next at 311592128573ns, rc = 0 00000004:00010000:3.0:1789265455.358586:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1d5dfdb reply state 0000000097d26e30 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265455.358598:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265455.358754:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:10435:x1876180533812224:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 913us (1125us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789265455.358765:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 75 00010000:00010000:0.0:1789265455.360250:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.360272:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.360282:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.360290:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265455.360295:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.360304:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.360324:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:0.0:1789265455.360328:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789265455.360370:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.360378:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818f9bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.364912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265455.364993:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533812352 00000100:00100000:1.0:1789265455.365007:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533812352 00000100:00100000:1.0:1789265455.365078:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:1.0:1789265455.365088:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:10435:x1876180533812352:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265455.365118:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265455.365142:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84dd expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.365231:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 35 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.365249:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 35 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.365271:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265455.365283:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265455.365288:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5ee00, rc 0) 00000100:00100000:1.0:1789265455.365376:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:10435:x1876180533812352:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 289us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265455.365384:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:2.0:1789265455.377876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.377969:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533812480 00000100:00100000:3.0:1789265455.377983:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533812480 00000100:00100000:3.0:1789265455.378075:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:3.0:1789265455.378086:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876180533812480:12345-192.168.204.43@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789265455.378134:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:3.0:1789265455.378177:0:6680:0:(genops.c:1385:class_connect()) connect: client b9773a89-f93c-421a-9c50-bfa3d5c6f2fa, cookie 0x8e12577ef818f9ca 00002000:00100000:3.0:1789265455.378196:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b9773a89-f93c-421a-9c50-bfa3d5c6f2fa/ffff92540a450800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265455.378212:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789265455.378580:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789265455.378622:0:6680:0:(import.c:65:import_set_state_nolock()) ffff92540a457000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265455.381801:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2341:x1876180533812480:12345-192.168.204.43@tcp:8:lhsmtool_posix.0 Request processed in 3695us (3921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.381819:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:1.0:1789265455.388816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.388973:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533812608 00000100:00100000:3.0:1789265455.388987:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533812608 00000100:00100000:3.0:1789265455.389081:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:3.0:1789265455.389106:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:0:x1876180533812608:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789265455.391564:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789265455.401919:0:11987:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265455.401933:0:11987:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265455.401996:0:11987:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789265455.402006:0:11987:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1789265455.451993:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1789265455.452019:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000100:00100000:1.0:1789265455.452319:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:0:x1876180533812608:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 63207us (63511us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265455.452367:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:2.0:1789265455.458574:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.458905:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533812864 00000100:00100000:3.0:1789265455.458976:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533812864 00000100:00100000:3.0:1789265455.459050:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:3.0:1789265455.459061:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:10435:x1876180533812864:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265455.459419:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:10435:x1876180533812864:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 358us (861us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789265455.459428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:3.0:1789265455.470718:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.472745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533813120 00000100:00100000:2.0:1789265455.472766:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533813120 00000100:00100000:2.0:1789265455.472861:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:2.0:1789265455.472873:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:10435:x1876180533813120:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265455.473199:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:10435:x1876180533813120:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 327us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265455.473218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:2.0:1789265455.478998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265455.479263:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533813248 00000100:00100000:0.0:1789265455.479277:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533813248 00000100:00100000:0.0:1789265455.479376:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:0.0:1789265455.479390:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:10435:x1876180533813248:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265455.479418:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265455.479461:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f9d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.479569:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef818f9d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.479588:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef818f9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.479604:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef818f9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265455.479657:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265455.479682:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef818f9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.479714:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818f9d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84e4 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.479734:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef818f9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84e4 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.479745:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:0.0:1789265455.479761:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789265455.479765:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995e00, rc 0) 00000100:00100000:0.0:1789265455.479855:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:10435:x1876180533813248:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 468us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265455.479863:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:3.0:1789265455.483522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265455.483638:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533813376 00000100:00100000:0.0:1789265455.483655:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533813376 00000100:00100000:0.0:1789265455.483734:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:0.0:1789265455.483748:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533813376:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265455.483775:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265455.483809:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84eb expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265455.483850:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6062e, blocks: 0x1 00010000:00010000:0.0:1789265455.483879:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1789265455.483885:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265455.483899:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.483927:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.483947:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994c00, rc 0) 00000100:00100000:0.0:1789265455.484038:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533813376:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 290us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265455.484046:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:2.0:1789265455.490944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.491625:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533813632 00000100:00100000:3.0:1789265455.491641:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533813632 00000100:00100000:3.0:1789265455.491720:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:3.0:1789265455.491732:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:10435:x1876180533813632:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265455.491907:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:10435:x1876180533813632:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 177us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.491914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:1.0:1789265455.496847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265455.496991:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533813760 00000100:00100000:0.0:1789265455.497007:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533813760 00000100:00100000:0.0:1789265455.497082:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:0.0:1789265455.497094:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:10435:x1876180533813760:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265455.497121:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265455.497149:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84f2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.497192:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.497204:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265455.497209:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265455.497215:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.497261:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.497276:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 7 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265455.497292:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1876180553759744:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265455.498012:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403536180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265455.502201:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1876180553759744:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265455.502252:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.502280:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994e00, rc 0) 00000100:00100000:1.0:1789265455.502374:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:10435:x1876180533813760:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 5281us (5543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265455.502384:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:1.0:1789265455.504076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.504486:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533813888 00000100:00100000:2.0:1789265455.504501:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533813888 00010000:00010000:2.0:1789265455.504559:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 7 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.504617:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:2.0:1789265455.504628:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533813888:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265455.504647:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265455.504681:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 7 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.504697:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 7 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.504732:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef818f9df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84eb expref: 7 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.504750:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265455.504755:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265455.504765:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.504798:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.504857:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.504875:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1876180553759872:192.168.204.43@tcp:105: 00000100:00100000:2.0:1789265455.505202:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265455.515168:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265455.515254:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533814016 00000100:00100000:0.0:1789265455.515268:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533814016 00002000:00100000:0.0:1789265455.515362:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff925441a9dc00 x1876180533814016/t0(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:26/0 lens 504/0 e 0 to 0 dl 1789265466 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265455.515388:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925441a9dc00 with x1876180533814016 ext(0->8) 00002000:00010000:0.0:1789265455.515396:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925441a9dc00 00000100:00100000:0.0:1789265455.515456:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:0.0:1789265455.515470:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533814016:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265455.516485:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2342:x1876180533814016:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 Request processed in 1015us (1326us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789265455.516497:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00002000:00100000:0.0:1789265455.516505:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff925441a9dc00 x1876180533814016/t4294967302(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:26/0 lens 504/448 e 0 to 0 dl 1789265466 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265455.516515:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925441a9dc00 with x1876180533814016 ext(0->8) 00002000:00010000:0.0:1789265455.516520:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925441a9dc00 00000100:00100000:2.0:1789265455.523673:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1876180553759872:192.168.204.43@tcp:105: 00010000:00010000:2.0:1789265455.523711:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265455.523890:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533813888:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 19262us (19821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265455.523904:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:0.0:1789265455.528685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.531056:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533814144 00000100:00100000:2.0:1789265455.531075:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533814144 00000100:00100000:2.0:1789265455.531313:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:2.0:1789265455.531328:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:10435:x1876180533814144:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1789265455.649125:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265455.651469:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:10435:x1876180533814144:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 120113us (122770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.651510:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 80 00000001:00080000:3.0:1789265455.652600:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:3.0:1789265455.652677:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1789265455.652700:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1789265455.652712:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789265455.652750:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789265455.652769:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789265455.665474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.665525:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553760000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789265455.665808:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533814272 00000100:00100000:0.0:1789265455.665820:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533814272 00000100:00100000:0.0:1789265455.665899:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:0.0:1789265455.665919:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533814272:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789265455.666287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265455.666937:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553760000 00000100:00100000:0.0:1789265455.666945:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553760000 00000100:00100000:0.0:1789265455.666984:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265455.666993:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553760000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789265455.667252:0:9090:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789265455.667257:0:9090:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789265454 00002000:00010000:0.0:1789265455.667260:0:9090:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789265455.667277:0:9090:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789265454 -> 1789265454 00002000:00010000:0.0:1789265455.667280:0:9090:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789265455.667372:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876180553760000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 378us (1084us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789265455.667381:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:0.0:1789265455.667454:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92543775e300/2, rc 0, transno 4294967303 00000100:00100000:0.0:1789265455.667461:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553760000:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789265455.778254:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1789265455.778579:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533814272:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 112664us (113110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265455.778592:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:0.0:1789265455.783394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.783972:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533814528 00000100:00100000:2.0:1789265455.783983:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533814528 00000100:00100000:2.0:1789265455.784048:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:2.0:1789265455.784059:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:10435:x1876180533814528:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265455.784115:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265455.784148:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef818f9d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84e4 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.784187:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265455.784193:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265455.784227:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.784242:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.784253:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265455.784595:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bdb1072 reply state 00000000dc7627a7 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.784605:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265455.784708:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10435:x1876180533814528:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 650us (1324us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789265455.784716:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 81 00010000:00010000:3.0:1789265455.788519:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.788540:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.788548:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.788553:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265455.788558:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.788565:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.788584:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265455.788587:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265455.788613:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.788620:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818f9ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265455.792825:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.793016:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533814656 00000100:00100000:3.0:1789265455.793026:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533814656 00000100:00100000:3.0:1789265455.793092:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:3.0:1789265455.793103:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533814656:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789265455.793325:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789265455.793565:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789265454 -> 1789265453 00002000:00010000:3.0:1789265455.793569:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789265451 00002000:00010000:3.0:1789265455.793572:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789265454 -> 1789265453 00002000:00010000:3.0:1789265455.793574:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789265455.793637:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533814656:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 534us (822us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789265455.793645:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:0.0:1789265455.798806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.798931:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533814912 00000100:00100000:2.0:1789265455.798942:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533814912 00000100:00100000:2.0:1789265455.799021:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:2.0:1789265455.799031:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:10435:x1876180533814912:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789265455.799104:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.799121:0:9189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.799159:0:9189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.799194:0:9189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.799208:0:9189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 13 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.799223:0:9189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553760128:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265455.799328:0:9189:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265455.808615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.809364:0:9189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553760128:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265455.809398:0:9189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265455.809477:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533815040 00000100:00100000:3.0:1789265455.809495:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533815040 00010000:00010000:3.0:1789265455.809558:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 14 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265455.809610:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:3.0:1789265455.809622:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2343:x1876180533815040:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265455.809642:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265455.809651:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 14 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.809813:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 14 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.809846:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818f9b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84d6 expref: 14 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.809868:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265455.809875:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.809886:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.809896:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.810861:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265455.810964:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:2343:x1876180533815040:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1337us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.810976:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00010000:00010000:0.0:1789265455.813884:0:9189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.813910:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.814102:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.814121:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.814129:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.814135:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265455.814140:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.814174:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.814193:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265455.814196:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789265455.814202:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.814208:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818f9f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.814325:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:10435:x1876180533814912:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 Request processed in 15280us (15513us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789265455.814367:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:1.0:1789265455.816593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265455.817429:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533815168 00000100:00100000:0.0:1789265455.817458:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533815168 00000100:00100000:2.0:1789265455.817656:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:2.0:1789265455.817670:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533815168:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789265455.817732:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.817755:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.817764:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789265455.817768:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265455.817774:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.817833:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.817849:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 7 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.817867:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1876180553760256:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265455.817962:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265455.824506:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1876180553760256:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265455.824542:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265455.838102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.838596:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533815296 00000100:00100000:3.0:1789265455.838611:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533815296 00010000:00010000:3.0:1789265455.838674:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 8 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265455.838728:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:3.0:1789265455.838739:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533815296:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265455.838777:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265455.838804:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 8 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.838820:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 8 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.838848:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eaf6d0a/0x8e12577ef818f9e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f2 expref: 8 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.838868:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265455.838873:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265455.838879:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.838901:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.838938:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265455.839005:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533815296:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 268us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.839014:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00010000:00010000:1.0:1789265455.842838:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.842861:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.842912:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.842922:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.842932:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.842940:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265455.842945:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.842955:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.842984:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.842993:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818f9fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265455.843163:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533815168:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 25490us (26574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265455.843175:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:1.0:1789265455.849143:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.849236:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533815552 00000100:00100000:3.0:1789265455.849246:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533815552 00000100:00100000:3.0:1789265455.849311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:3.0:1789265455.849322:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:10435:x1876180533815552:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789265455.849480:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.849500:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.849513:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.849773:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.849786:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 13 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.849794:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.849836:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 13 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.849851:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 13 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265455.849866:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876180553760384:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265455.849948:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265455.855864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265455.856029:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533815680 00000100:00100000:2.0:1789265455.856039:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533815680 00010000:00010000:2.0:1789265455.856079:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 14 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.856129:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:2.0:1789265455.856139:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2343:x1876180533815680:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265455.856153:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265455.856160:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 14 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.856174:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 14 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.856220:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265455.856225:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.856234:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.856242:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.856258:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265455.856444:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818f9c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84dd expref: 14 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265455.856464:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876180553760384:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265455.856499:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.856508:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.856513:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265455.856719:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789265455.856897:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789265455.856946:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789265455.857027:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876180553760512:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789265455.857078:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265455.857109:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265455.857137:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553760512 00000100:00100000:3.0:1789265455.857142:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553760512 00000100:00100000:3.0:1789265455.857179:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265455.857187:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1876180553760512:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789265455.857251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1876180553760512:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.857259:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265455.857298:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876180553760512:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789265455.857813:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789265455.857860:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:2343:x1876180533815680:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1719us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.857873:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876180553760640:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789265455.857905:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265455.857922:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265455.857938:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553760640 00000100:00100000:3.0:1789265455.857947:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553760640 00000100:00100000:2.0:1789265455.857947:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:3.0:1789265455.857971:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265455.857977:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1876180553760640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789265455.858167:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1876180553760640:12345-0@lo:1000:mdt00_002.0 Request processed in 189us (260us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789265455.858175:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265455.858623:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1876180553760640:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789265455.858655:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858666:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858673:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858679:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265455.858684:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858692:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858718:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265455.858721:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265455.858727:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858733:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fa09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858776:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858783:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858789:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858795:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265455.858797:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858803:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858810:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265455.858813:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265455.858816:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858821:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818f93e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858855:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858869:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 16 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858889:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858917:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 16 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.858932:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 16 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265455.858943:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876180553760768:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265455.859003:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265455.862017:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876180553760768:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265455.862048:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265455.862833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.862915:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533815808 00000100:00100000:3.0:1789265455.862924:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533815808 00010000:00010000:3.0:1789265455.862966:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 17 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265455.863009:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:3.0:1789265455.863020:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:2343:x1876180533815808:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265455.863035:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265455.863041:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 17 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.863053:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 17 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.863078:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818f95a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84c1 expref: 17 pid: 9387 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.863096:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074700) 00010000:00010000:3.0:1789265455.863102:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.863113:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.863137:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265455.863169:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265455.863239:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:2343:x1876180533815808:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 219us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265455.863246:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00010000:00010000:0.0:1789265455.863644:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863653:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863667:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863674:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863687:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863693:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265455.863698:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863705:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863716:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265455.863719:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265455.863723:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863729:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863742:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863748:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863753:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863759:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265455.863761:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863780:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863790:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265455.863792:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265455.863795:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265455.863801:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265455.864035:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:10435:x1876180533815552:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 14713us (14900us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789265455.864045:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 83 00000020:00080000:0.0:1789265455.864049:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789265455.864325:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265455.864352:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265455.864387:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789265455.864396:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265455.872769:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265455.873596:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533816064 00000100:00100000:3.0:1789265455.873609:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533816064 00000100:00100000:3.0:1789265455.873678:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:3.0:1789265455.873695:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:10435:x1876180533816064:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789265455.878746:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789265455.878904:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789265455.879356:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.879375:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.879400:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.879410:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.879417:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.879423:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265455.879526:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265455.879663:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:10435:x1876180533816064:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 5965us (6898us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789265455.879675:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000020:00080000:2.0:1789265455.879682:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789265455.881775:0:11651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265455.881790:0:11651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.881802:0:11651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265455.881807:0:11651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.881817:0:11651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.881835:0:11651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265455.881839:0:11651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265455.881843:0:11651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.881850:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fa17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265455.881877:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265455.881880:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265455.881882:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265456.678247:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265457.054758:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553760896:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.054834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265457.054901:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553761408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.054929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265457.054955:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265457.054960:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553761024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.054981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265457.054996:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553761536:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265457.055047:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553761280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265457.055088:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265457.055093:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876180553761152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265457.055147:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553761408 00000100:00100000:1.0:1789265457.055155:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553761408 00000100:00100000:1.0:1789265457.055204:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553761024 00000100:00100000:1.0:1789265457.055207:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553761024 00000100:00100000:1.0:1789265457.055227:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553761152 00000100:00100000:1.0:1789265457.055229:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553761152 00000100:00100000:1.0:1789265457.055246:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789265457.055255:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553761408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055306:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553761408:12345-0@lo:400:kworker.0 Request processed in 52us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265457.055313:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789265457.055364:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789265457.055372:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553761024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055401:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553761024:12345-0@lo:400:kworker.0 Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265457.055433:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789265457.055448:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789265457.055454:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876180553761152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055487:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876180553761152:12345-0@lo:400:kworker.0 Request processed in 33us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265457.055493:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789265457.055512:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553761536 00000100:00100000:1.0:1789265457.055516:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553761536 00000100:00100000:1.0:1789265457.055540:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553761280 00000100:00100000:1.0:1789265457.055543:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553761280 00000100:00100000:1.0:1789265457.055561:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265457.055567:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553761536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055595:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553761536:12345-0@lo:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265457.055601:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265457.055612:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265457.055617:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553761280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055643:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553761280:12345-0@lo:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265457.055649:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789265457.055672:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265457.055676:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265457.055680:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265457.055721:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876180553761152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055734:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553761280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055760:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553761024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055780:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553761536:0@lo:400:kworker.0 00000100:00100000:1.0:1789265457.055790:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553761408:0@lo:400:kworker.0 00000100:00100000:0.0:1789265457.058779:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553760896 00000100:00100000:0.0:1789265457.058791:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553760896 00000100:00100000:0.0:1789265457.058861:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789265457.058872:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553760896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265457.058969:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553760896:12345-0@lo:400:kworker.0 Request processed in 99us (4134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265457.058976:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789265457.059263:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553760896:0@lo:400:kworker.0 00000040:00080000:1.0:1789265457.508752:0:12039:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265457.509863:0:12039:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265457.509948:0:12039:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789265457.509955:0:12039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265457.566755:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265457.566780:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553761664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265457.566874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265457.567264:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553761664 00000100:00100000:2.0:1789265457.567273:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553761664 00000100:00100000:2.0:1789265457.567362:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265457.567372:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553761664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265457.567418:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265457.567471:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553761664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265457.567479:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789265457.567748:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553761664:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789265457.649421:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1789265457.649441:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1789265457.695665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:2.0:1789265457.696319:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265457.696815:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533816320 00000100:00100000:3.0:1789265457.696830:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533816320 00000100:00100000:3.0:1789265457.696985:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:3.0:1789265457.696995:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:10454:x1876180533816320:12345-192.168.204.43@tcp:101:lfs.0 00000100:00080000:1.0:1789265457.697085:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789265457.697126:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265457.697150:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f84f9 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.697253:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.697269:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.697299:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265457.697312:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789265457.697468:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f9 expref: 20 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.697489:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f9 expref: 19 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.697498:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:3.0:1789265457.697502:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265457.697505:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884400, rc 0) 00000100:00100000:3.0:1789265457.697568:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10454:x1876180533816320:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 574us (1913us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789265457.697576:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:3.0:1789265457.707652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265457.707746:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533816448 00000100:00100000:1.0:1789265457.707758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533816448 00000100:00100000:1.0:1789265457.707922:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:1.0:1789265457.707934:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10454:x1876180533816448:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:1.0:1789265457.708032:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708049:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708061:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708077:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708084:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708105:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708431:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708440:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708448:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265457.708489:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708503:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708510:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708516:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708522:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ec00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265457.708527:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708534:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708547:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265457.708555:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265457.708560:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708567:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708579:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708585:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708590:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708595:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265457.708598:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708603:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708610:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540cd7a000) 00010000:00010000:1.0:1789265457.708612:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265457.708615:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708619:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708632:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708643:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708650:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708655:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265457.708658:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708663:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708671:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540cd7ad00) 00010000:00010000:1.0:1789265457.708673:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265457.708675:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.708680:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265457.709154:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10454:x1876180533816448:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1219us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265457.709164:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:3.0:1789265457.799427:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265457.799530:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533816704 00000100:00100000:0.0:1789265457.799541:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533816704 00000100:00100000:0.0:1789265457.799603:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:0.0:1789265457.799614:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:10457:x1876180533816704:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265457.799637:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265457.799660:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818fa48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8500 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.799738:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.799754:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.799767:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.799784:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.799791:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.799799:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800078:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800087:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800106:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265457.800117:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789265457.800222:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800230:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800236:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800242:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265457.800247:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800254:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800269:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:0.0:1789265457.800273:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265457.800277:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800283:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fa4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800295:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800302:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800314:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800319:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265457.800323:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800378:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800391:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92542b074a00) 00010000:00010000:0.0:1789265457.800403:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265457.800406:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800412:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fa56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800456:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818fa48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800470:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.800477:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:0.0:1789265457.800480:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265457.800482:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995c00, rc 0) 00000100:00100000:0.0:1789265457.800546:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10457:x1876180533816704:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 932us (1127us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789265457.800569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:1.0:1789265457.805215:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265457.805621:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533816832 00000100:00100000:3.0:1789265457.805631:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533816832 00000100:00100000:3.0:1789265457.805728:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:3.0:1789265457.805739:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10457:x1876180533816832:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:3.0:1789265457.805811:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805829:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805871:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805897:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805905:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805912:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805918:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265457.805922:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805929:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805940:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:3.0:1789265457.805944:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265457.805948:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265457.805953:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fa6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265457.806030:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10457:x1876180533816832:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 292us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265457.806037:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:3.0:1789265457.817525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265457.819298:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533817088 00000100:00100000:1.0:1789265457.819314:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533817088 00000100:00100000:1.0:1789265457.819412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:1.0:1789265457.819423:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10457:x1876180533817088:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1789265457.819718:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:10457:x1876180533817088:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 296us (2433us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789265457.819727:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1789265457.861031:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265457.861140:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533817344 00000100:00100000:1.0:1789265457.861150:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533817344 00000100:00100000:1.0:1789265457.861214:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:1.0:1789265457.861223:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:9979:x1876180533817344:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1789265457.861250:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265457.861274:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8507 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.861444:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.861460:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.861469:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.861504:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.861518:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 23 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265457.861532:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b456680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876180553761792:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265457.861654:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265457.865134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265457.865257:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533817472 00000100:00100000:2.0:1789265457.865284:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533817472 00010000:00010000:2.0:1789265457.865326:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 24 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265457.865443:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:2.0:1789265457.865453:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:2342:x1876180533817472:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265457.865468:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265457.865475:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 24 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265457.865488:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 24 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265457.865515:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:2.0:1789265457.865521:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265457.865530:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265457.865537:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265457.865556:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265457.865604:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:2342:x1876180533817472:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 152us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265457.865622:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00010000:00010000:1.0:1789265457.866421:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fa5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8500 expref: 23 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265457.866446:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b456680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876180553761792:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265457.866473:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.866482:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.866488:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265457.866508:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789265457.866725:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.866741:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.866749:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:1.0:1789265457.866751:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265457.866754:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5e800, rc 0) 00000100:00100000:1.0:1789265457.866866:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:9979:x1876180533817344:12345-192.168.204.43@tcp:101:bash.0 Request processed in 5642us (5845us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789265457.866874:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:3.0:1789265457.869995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265457.870091:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533817728 00000100:00100000:1.0:1789265457.870120:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533817728 00000100:00100000:1.0:1789265457.870185:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00100000:1.0:1789265457.870196:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:9979:x1876180533817728:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:1.0:1789265457.870868:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.870890:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.870903:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265457.870962:0:9189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789265457.870987:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd4a2b23 reply state 00000000c2e6f1e6 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265457.870998:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789265457.871051:0:9189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789265457.871230:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:9979:x1876180533817728:12345-192.168.204.43@tcp:36:bash.0 Request processed in 1033us (1242us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789265457.871238:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 89 00000020:00080000:1.0:1789265457.871243:0:9189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789265457.873934:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.873952:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.873961:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.874026:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ec00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265457.874031:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.874040:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.874056:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:0.0:1789265457.874059:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265457.874063:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265457.874070:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fa87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265457.874485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265457.874574:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533817856 00000100:00100000:1.0:1789265457.874583:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533817856 00000100:00100000:1.0:1789265457.874635:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:1.0:1789265457.874645:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:9979:x1876180533817856:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1789265457.874670:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265457.874690:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f850e expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.874765:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f850e expref: 27 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.874780:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f850e expref: 27 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.874798:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:1.0:1789265457.874801:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265457.874804:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5fc00, rc 0) 00000100:00100000:1.0:1789265457.874880:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:9979:x1876180533817856:12345-192.168.204.43@tcp:101:bash.0 Request processed in 236us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265457.874888:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:3.0:1789265457.877928:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265457.878064:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533817984 00000100:00100000:1.0:1789265457.878072:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533817984 00000100:00100000:1.0:1789265457.878225:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:1.0:1789265457.878235:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:9979:x1876180533817984:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1789265457.878253:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265457.878278:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8515 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265457.878309:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa6062d, atime: 0x6aa6062b, ctime: 0x6aa6062d, blocks: 0xb 00010000:00010000:1.0:1789265457.878365:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:1.0:1789265457.878370:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265457.878378:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.878433:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.878446:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5ee00, rc 0) 00000100:00100000:1.0:1789265457.878496:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:9979:x1876180533817984:12345-192.168.204.43@tcp:101:bash.0 Request processed in 263us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265457.878503:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00080000:2.0:1789265457.878727:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265457.880996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265457.881098:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533818112 00000100:00100000:0.0:1789265457.881107:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533818112 00002000:00010000:0.0:1789265457.881148:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789265457.881153:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543775f100 with x1876180533818112 ext(0->18446744073709551615) 00002000:00010000:0.0:1789265457.881165:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92543775f100. 00000100:00100000:0.0:1789265457.881255:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:0.0:1789265457.881264:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533818112:12345-192.168.204.43@tcp:10:bash.0 00002000:00010000:0.0:1789265457.881592:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789265457.881596:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789265453 -> 1789265457 00002000:00010000:0.0:1789265457.881598:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789265451 -> 1789265451 00002000:00010000:0.0:1789265457.881600:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789265453 -> 1789265457 00002000:00010000:0.0:1789265457.881602:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789265457.881654:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2345:x1876180533818112:12345-192.168.204.43@tcp:10:bash.0 Request processed in 391us (667us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789265457.881661:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00002000:00010000:0.0:1789265457.881665:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789265457.881667:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543775f100 with x1876180533818112 ext(0->18446744073709551615) 00002000:00010000:0.0:1789265457.881671:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92543775f100. 00000100:00100000:3.0:1789265457.961590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265457.961729:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533818240 00000100:00100000:1.0:1789265457.961741:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533818240 00000100:00100000:1.0:1789265457.961805:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 91 00000100:00100000:1.0:1789265457.961815:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:10471:x1876180533818240:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:1.0:1789265457.961908:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.961927:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.961941:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962218:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962227:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962234:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962616:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962627:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962634:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265457.962678:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962691:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962698:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962704:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962711:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265457.962714:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962722:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962735:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265457.962739:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265457.962743:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962756:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fa9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962770:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962776:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962782:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962786:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265457.962789:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962795:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962803:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540cd7a300) 00010000:00010000:1.0:1789265457.962805:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265457.962808:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962813:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818faa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962828:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.962834:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.963825:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.963830:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fa00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265457.963834:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.963852:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.963864:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:1.0:1789265457.963866:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265457.963870:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265457.963877:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818faaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265457.964150:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:10471:x1876180533818240:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 2330us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265457.964171:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 91 00000100:00100000:1.0:1789265458.011418:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.011661:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533818496 00000100:00100000:2.0:1789265458.011674:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533818496 00000100:00100000:2.0:1789265458.011744:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:2.0:1789265458.011755:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:10474:x1876180533818496:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265458.011781:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265458.011815:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f851c expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.011891:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.011907:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.011917:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.011933:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.011941:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.011959:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013174:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013208:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013219:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265458.013234:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789265458.013721:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013731:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013738:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013745:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265458.013749:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013757:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013771:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265458.013774:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265458.013778:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013784:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013919:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013934:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.013940:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.014215:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265458.014219:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.014225:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.014235:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540ccf3e00) 00010000:00010000:2.0:1789265458.014238:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265458.014241:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.014247:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fabf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.014301:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f851c expref: 30 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.014316:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f851c expref: 29 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.014324:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:2.0:1789265458.014326:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265458.014529:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137c00, rc 0) 00000100:00100000:2.0:1789265458.014614:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10474:x1876180533818496:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 2859us (3208us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789265458.014623:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:0.0:1789265458.027481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.028424:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533818624 00000100:00100000:2.0:1789265458.028442:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533818624 00000100:00100000:2.0:1789265458.028547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:2.0:1789265458.028561:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10474:x1876180533818624:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:2.0:1789265458.028670:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.028694:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.028706:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.028755:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.028773:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 29 pid: 5834 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265458.028802:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553761920:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265458.031201:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265458.042707:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.042899:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553761920:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265458.042948:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265458.047491:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533818880 00000100:00100000:1.0:1789265458.047526:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533818880 00000100:00100000:0.0:1789265458.047721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:0.0:1789265458.047735:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:5586:x1876180533818880:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789265458.049091:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:5586:x1876180533818880:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 1348us (6391us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789265458.049104:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1789265458.052459:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265458.052727:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533819008 00000100:00100000:1.0:1789265458.052744:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533819008 00010000:00010000:1.0:1789265458.052817:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 31 pid: 5834 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265458.052877:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:1.0:1789265458.052889:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:2342:x1876180533819008:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265458.052915:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265458.052943:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 31 pid: 5834 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.052959:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 31 pid: 5834 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.052987:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fa79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8507 expref: 31 pid: 5834 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.053007:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:1.0:1789265458.053014:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.053026:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.053034:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.053066:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265458.053158:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:2342:x1876180533819008:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 270us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265458.053165:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00010000:00010000:0.0:1789265458.054647:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.054668:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.054730:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.054754:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.054762:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.054769:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265458.054774:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.054783:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.054813:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:0.0:1789265458.054816:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265458.054821:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.054827:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265458.054939:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10474:x1876180533818624:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 26376us (27470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265458.054950:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:3.0:1789265458.058176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265458.058454:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533819264 00000100:00100000:0.0:1789265458.058469:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533819264 00000100:00100000:0.0:1789265458.058546:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:0.0:1789265458.058558:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:10474:x1876180533819264:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265458.059306:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10474:x1876180533819264:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 743us (1137us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789265458.059354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:3.0:1789265458.192870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.192995:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533819520 00000100:00100000:2.0:1789265458.193015:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533819520 00000100:00100000:2.0:1789265458.193116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:2.0:1789265458.193130:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:10485:x1876180533819520:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:2.0:1789265458.193504:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265458.193533:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fadb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8523 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.193646:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.193665:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.193681:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.193698:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.193707:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.193713:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.195805:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818faf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.195827:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818faf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.195850:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818faf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265458.195869:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789265458.196001:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196010:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196017:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196024:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265458.196030:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196038:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196053:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265458.196056:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265458.196062:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196069:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196084:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196090:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196103:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196109:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265458.196112:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196118:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196127:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540ccf3e00) 00010000:00010000:2.0:1789265458.196130:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265458.196133:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196139:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196209:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fadb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8523 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196227:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818faf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8523 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.196235:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:2.0:1789265458.196237:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265458.196239:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137400, rc 0) 00000100:00100000:2.0:1789265458.196405:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10485:x1876180533819520:12345-192.168.204.43@tcp:101:cat.0 Request processed in 3278us (3547us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789265458.196424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:3.0:1789265458.205030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.205218:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533819776 00000100:00100000:2.0:1789265458.205233:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533819776 00000100:00100000:2.0:1789265458.205322:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:2.0:1789265458.205376:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10485:x1876180533819776:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:2.0:1789265458.205717:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10485:x1876180533819776:12345-192.168.204.43@tcp:35:cat.0 Request processed in 383us (702us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789265458.205726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:3.0:1789265458.238224:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.238379:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533820032 00000100:00100000:2.0:1789265458.238403:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533820032 00000100:00100000:2.0:1789265458.238633:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 95 00000100:00100000:2.0:1789265458.238647:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10486:x1876180533820032:12345-192.168.204.43@tcp:36:rm.0 00010000:00010000:2.0:1789265458.238742:0:9189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789265458.238782:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818faf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8523 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.238822:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f851c expref: 32 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.238844:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fa8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f850e expref: 31 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.238856:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92542b074d00) 00010000:00010000:2.0:1789265458.238870:0:9189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265458.238898:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.238932:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.238945:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.238963:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.238970:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.238976:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.241133:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.241163:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.241177:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265458.250031:0:9189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1789265458.250053:0:9189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313483719927ns, next at 314483714575ns, rc = 0 00010000:00010000:0.0:1789265458.250168:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250193:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250211:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250220:0:9189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250227:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250234:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250261:0:9189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265458.250295:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250302:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250326:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250689:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265458.250707:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250717:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250734:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3100) 00010000:00010000:0.0:1789265458.250738:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789265458.250743:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.250748:0:11652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265458.250749:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fb0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.250756:0:11652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.250762:0:11652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994e00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265458.250766:0:11652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.250772:0:11652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250774:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250780:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.250783:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92540ccf3100) 00010000:00010000:3.0:1789265458.250785:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265458.250787:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.250788:0:11652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250793:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265458.250794:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818fb13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250796:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250802:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250808:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:0.0:1789265458.250810:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265458.250817:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.250823:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fafe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.250824:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265458.250826:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265458.250828:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789265458.250849:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b63d095b reply state 00000000c080fa54 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265458.250861:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265458.250989:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:10486:x1876180533820032:12345-192.168.204.43@tcp:36:rm.0 Request processed in 12339us (12775us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789265458.251000:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 95 00010000:00010000:2.0:1789265458.266382:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.266415:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.266423:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.266456:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265458.266462:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.266470:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.266492:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540ccf3e00) 00010000:00010000:2.0:1789265458.266495:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265458.266500:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.266506:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265458.322865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265458.323751:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533820288 00000100:00100000:0.0:1789265458.323766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533820288 00000100:00100000:0.0:1789265458.323904:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:0.0:1789265458.323916:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:10492:x1876180533820288:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265458.323949:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265458.323975:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818fb1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f852a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.324145:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.324163:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.324177:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.324195:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.324222:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.324229:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265458.329076:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789265458.329977:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330001:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330015:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330064:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330072:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330080:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330086:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265458.330434:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330445:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330479:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:0.0:1789265458.330482:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265458.330487:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.330493:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fb21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265458.330509:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000732250c0 reply state 00000000d5ad8fda transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265458.330520:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789265458.331251:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818fb1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.331275:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.331285:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92542b074500) 00010000:00010000:0.0:1789265458.331288:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265458.331291:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995800, rc 0) 00000100:00100000:0.0:1789265458.332522:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:10492:x1876180533820288:12345-192.168.204.43@tcp:101:bash.0 Request processed in 8595us (9660us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789265458.332536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 96 00010000:00010000:1.0:1789265458.337870:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.337896:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.337906:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.337935:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265458.337943:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.337952:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.337975:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92542b074a00) 00010000:00010000:1.0:1789265458.337979:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265458.337984:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.337992:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fb28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265458.338289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.338826:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533820416 00000100:00100000:2.0:1789265458.338850:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533820416 00000100:00100000:2.0:1789265458.338936:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:2.0:1789265458.338948:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533820416:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265458.338972:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265458.339004:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8531 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265458.339042:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265458.339068:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789265458.339073:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265458.339085:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.339140:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.339156:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136c00, rc 0) 00000100:00100000:2.0:1789265458.339243:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533820416:12345-192.168.204.43@tcp:101:bash.0 Request processed in 298us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265458.339251:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00080000:1.0:1789265458.340401:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265458.344589:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265458.344732:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533820544 00000100:00100000:1.0:1789265458.344746:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533820544 00000100:00100000:1.0:1789265458.344819:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:1.0:1789265458.344831:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543755b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:10492:x1876180533820544:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1789265458.344861:0:9090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265458.344885:0:9090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8538 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.344929:0:9090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.344959:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265458.344964:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265458.344969:0:9090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 7 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.345013:0:9090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.345029:0:9090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 7 pid: 6678 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265458.345045:0:9090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b454000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9090:1876180553762048:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265458.346740:0:9090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265458.350788:0:9090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b454000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9090:1876180553762048:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265458.350903:0:9090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 7 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.350933:0:9090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5fa00, rc 0) 00000100:00100000:1.0:1789265458.351019:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543755b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:10492:x1876180533820544:12345-192.168.204.43@tcp:101:bash.0 Request processed in 6188us (6449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265458.351029:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:0.0:1789265458.360131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.367023:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533820672 00000100:00100000:2.0:1789265458.367046:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533820672 00010000:00010000:2.0:1789265458.367184:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 7 pid: 6678 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265458.367249:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:2.0:1789265458.367262:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533820672:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265458.367284:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265458.367316:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 7 pid: 6678 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.367351:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 7 pid: 6678 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.367464:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fb3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8531 expref: 7 pid: 6678 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.367507:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265458.367513:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265458.367523:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 6 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.367536:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 6 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.367594:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 6 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265458.367612:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1876180553762176:192.168.204.43@tcp:105: 00000100:00100000:2.0:1789265458.367725:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265458.374406:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265458.374587:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533820928 00000100:00100000:1.0:1789265458.374601:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533820928 00000100:00100000:1.0:1789265458.374674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:1.0:1789265458.374707:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:10492:x1876180533820928:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:1.0:1789265458.376013:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:10492:x1876180533820928:12345-192.168.204.43@tcp:35:bash.0 Request processed in 1298us (1621us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789265458.376026:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:2.0:1789265458.384090:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1876180553762176:192.168.204.43@tcp:105: 00010000:00010000:2.0:1789265458.384140:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265458.384241:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533820672:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 16981us (24128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265458.384255:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:0.0:1789265458.632186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.632663:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533821056 00000100:00100000:2.0:1789265458.632681:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533821056 00000100:00100000:2.0:1789265458.632770:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:2.0:1789265458.632782:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:10508:x1876180533821056:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265458.632819:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265458.632859:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f853f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.633268:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fb52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.633289:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.633303:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265458.633392:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789265458.633396:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265458.633420:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.633453:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f853f expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.633477:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fb52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f853f expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.633487:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265458.633490:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265458.633495:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137c00, rc 0) 00000100:00100000:2.0:1789265458.634001:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:10508:x1876180533821056:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1216us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265458.634021:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:1.0:1789265458.659472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265458.660140:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533821312 00000100:00100000:0.0:1789265458.660156:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533821312 00000100:00100000:0.0:1789265458.660242:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:0.0:1789265458.660256:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:10508:x1876180533821312:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265458.660287:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265458.660315:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818fb59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8546 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.660523:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fb60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.660543:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.660558:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265458.660573:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789265458.660743:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818fb59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8546 expref: 38 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.660764:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fb60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8546 expref: 37 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.660774:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92542b074500) 00010000:00010000:0.0:1789265458.660777:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265458.660782:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995200, rc 0) 00000100:00100000:1.0:1789265458.661764:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:10508:x1876180533821312:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1502us (2299us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789265458.661775:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:0.0:1789265458.680428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265458.680473:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.680853:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533821696 00000100:00100000:2.0:1789265458.680866:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533821696 00000100:00100000:2.0:1789265458.680954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:2.0:1789265458.680965:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:10508:x1876180533821696:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265458.680996:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265458.681167:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f854d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.681297:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fb75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.681315:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.681329:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265458.681442:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789265458.681768:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f854d expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.681790:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fb75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f854d expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.681806:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92542b074500) 00010000:00010000:2.0:1789265458.681809:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265458.681813:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137400, rc 0) 00000100:00100000:1.0:1789265458.681934:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533821440 00000100:00100000:1.0:1789265458.681942:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533821440 00000100:00100000:1.0:1789265458.682135:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:1.0:1789265458.682145:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+40:2342:x1876180533821440:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265458.682158:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265458.682174:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fb60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8546 expref: 40 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.682186:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92542b074500) 00010000:00010000:1.0:1789265458.682189:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265458.682260:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+39:2342:x1876180533821440:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 117us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265458.682268:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1789265458.683460:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:10508:x1876180533821696:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 2484us (2972us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789265458.683473:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:0.0:1789265458.702884:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.703206:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533821824 00000100:00100000:2.0:1789265458.703227:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533821824 00000100:00100000:2.0:1789265458.703301:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:2.0:1789265458.703314:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533821824:12345-192.168.204.43@tcp:1:lfs.0 00010000:00010000:2.0:1789265458.703429:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.703461:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 6 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.703471:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265458.703476:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265458.703482:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.703533:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 6 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.703563:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 6 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265458.703583:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1876180553762304:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265458.703707:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265458.714181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265458.714423:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533821952 00000100:00100000:1.0:1789265458.714436:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533821952 00002000:00100000:1.0:1789265458.714500:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9254377d7100 x1876180533821952/t0(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:29/0 lens 504/0 e 0 to 0 dl 1789265469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265458.714513:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9254377d7100 with x1876180533821952 ext(0->8) 00010000:00010000:1.0:1789265458.714543:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 7 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.714563:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 7 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265458.714571:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9254377d7100 00000100:00100000:1.0:1789265458.714612:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:1.0:1789265458.714623:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533821952:12345-192.168.204.43@tcp:4:lfs.0 00000100:00100000:1.0:1789265458.715284:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2342:x1876180533821952:12345-192.168.204.43@tcp:4:lfs.0 Request processed in 658us (1115us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789265458.715294:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00002000:00100000:1.0:1789265458.715303:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9254377d7100 x1876180533821952/t4294967302(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:29/0 lens 504/448 e 0 to 0 dl 1789265469 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265458.715313:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9254377d7100 with x1876180533821952 ext(0->8) 00010000:00010000:1.0:1789265458.715321:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 9 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.715392:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 9 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265458.715402:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9254377d7100 00000100:00100000:2.0:1789265458.715533:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1876180553762304:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265458.715569:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.718572:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265458.722581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265458.722672:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533822080 00000100:00100000:3.0:1789265458.722684:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533822080 00010000:00010000:3.0:1789265458.722739:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 9 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265458.722797:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:3.0:1789265458.722810:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2345:x1876180533822080:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265458.722840:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789265458.722866:0:11653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789265458.722869:0:11653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789265457 00002000:00010000:3.0:1789265458.722872:0:11653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789265457 00002000:00010000:3.0:1789265458.722874:0:11653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789265457 00010000:00010000:3.0:1789265458.722881:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 9 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.722898:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 9 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.722928:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ebaac95/0x8e12577ef818fb44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8538 expref: 9 pid: 9090 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.722947:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265458.722969:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265458.722977:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.722988:0:11653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.723046:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265458.723130:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2345:x1876180533822080:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 321us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265458.723140:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00010000:00010000:1.0:1789265458.723641:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.723664:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.723699:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.723708:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.723718:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.723726:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265458.723731:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.723741:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.723757:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.723765:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef818fb83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265458.723861:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2344:x1876180533821824:12345-192.168.204.43@tcp:1:lfs.0 Request processed in 20549us (20995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265458.723871:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:1.0:1789265458.727810:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265458.727963:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533822336 00000100:00100000:0.0:1789265458.727977:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533822336 00000100:00100000:0.0:1789265458.728056:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:0.0:1789265458.728068:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:10508:x1876180533822336:12345-192.168.204.43@tcp:35:lfs.0 00000004:00010000:0.0:1789265458.728156:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fb75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f854d expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265458.728586:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1789265458.728635:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789265458.729039:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1789265458.729107:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.729128:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.729138:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.729186:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265458.729206:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 42 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265458.729224:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876180553762432:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265458.729385:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265458.736510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265458.736733:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533822464 00000100:00100000:3.0:1789265458.736748:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533822464 00010000:00010000:3.0:1789265458.736803:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 43 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265458.736865:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:3.0:1789265458.736879:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+43:2343:x1876180533822464:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265458.736900:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265458.736908:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 43 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.736924:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 43 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.736955:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92542b074500) 00010000:00010000:3.0:1789265458.736962:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.736993:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.737323:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265458.737395:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265458.737479:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+43:2343:x1876180533822464:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 601us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265458.737488:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00010000:00010000:2.0:1789265458.741791:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995800/0x8e12577ef818fb2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f852a expref: 42 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265458.741836:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1876180553762432:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265458.741875:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.741886:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.741893:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265458.742320:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789265458.742671:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1789265458.742818:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876180553762560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789265458.743594:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265458.743646:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c0c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265458.743794:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553762560 00000100:00100000:3.0:1789265458.743803:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553762560 00000100:00100000:3.0:1789265458.743949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265458.743961:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1876180553762560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789265458.744276:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1876180553762560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 316us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265458.744285:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265458.745135:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789265458.745147:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1789265458.745174:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff925402c48380, transno 4294967301 00000100:00100000:2.0:1789265458.745200:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876180553762560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789265458.749780:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789265458.751220:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876180553762688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789265458.751432:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265458.751474:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265458.751593:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553762688 00000100:00100000:0.0:1789265458.751609:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553762688 00000100:00100000:0.0:1789265458.751676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265458.751687:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1876180553762688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789265458.751959:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1876180553762688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 273us (527us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789265458.751967:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265458.752311:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254071ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1876180553762688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789265458.752443:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789265458.752502:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.752515:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.752524:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.752531:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265458.752536:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.752546:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.752910:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92542b074500) 00010000:00010000:2.0:1789265458.752914:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789265458.752921:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.752927:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fb8a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265458.753191:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789265458.753634:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1789265458.753649:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313987316177ns, next at 314987313061ns, rc = 0 00000001:00080000:2.0:1789265458.753658:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789265458.753708:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92542b074500) 00010000:00010000:2.0:1789265458.753726:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265458.753737:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fb75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f854d expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265458.754084:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+45:10508:x1876180533822336:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 26015us (26287us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789265458.754096:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000020:00080000:2.0:1789265458.754103:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789265458.771232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.771395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533822592 00000100:00100000:2.0:1789265458.771410:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533822592 00000100:00100000:2.0:1789265458.771480:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:2.0:1789265458.771492:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+45:10508:x1876180533822592:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265458.771523:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265458.771568:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8554 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.771653:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8554 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.771675:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8554 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.771701:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265458.771705:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265458.771710:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136c00, rc 0) 00000100:00100000:2.0:1789265458.771795:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+46:10508:x1876180533822592:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 305us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265458.771803:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:0.0:1789265458.781157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265458.781255:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533822848 00000100:00100000:1.0:1789265458.781272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533822848 00000100:00100000:1.0:1789265458.781419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:3.0:1789265458.781494:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+46:10508:x1876180533822848:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265458.781986:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+47:10508:x1876180533822848:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 554us (848us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789265458.781994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:3.0:1789265458.945269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265458.945459:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533822976 00000100:00100000:1.0:1789265458.945473:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533822976 00000100:00100000:1.0:1789265458.945555:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:1.0:1789265458.945569:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+47:10518:x1876180533822976:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:1.0:1789265458.945682:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.945707:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.945723:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.945743:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.945751:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.945758:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.945917:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.945928:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.945935:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265458.945992:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946006:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946013:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946019:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946026:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265458.946031:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946039:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946053:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265458.946056:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265458.946061:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946073:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fb98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946087:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946092:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946097:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946102:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fa00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265458.946105:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946111:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946118:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540cd7a300) 00010000:00010000:1.0:1789265458.946121:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265458.946124:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946129:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef818fb9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946144:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946150:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946162:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946167:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265458.946170:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946176:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946185:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265458.946188:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265458.946190:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265458.946196:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef818fba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265458.946305:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+47:10518:x1876180533822976:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 738us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265458.946313:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:1.0:1789265458.996310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265458.996480:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533823232 00000100:00100000:2.0:1789265458.996499:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533823232 00000100:00100000:2.0:1789265458.996598:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:2.0:1789265458.996611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+47:10521:x1876180533823232:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265458.996648:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265458.996909:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fbad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f855b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997029:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997048:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997064:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997081:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997088:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997094:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997262:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fbc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997271:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997298:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265458.997312:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789265458.997489:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997498:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997505:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997513:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265458.997519:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997527:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997542:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265458.997546:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265458.997552:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997559:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fbb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997572:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997578:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997591:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997596:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265458.997599:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997606:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997614:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540ccf3700) 00010000:00010000:2.0:1789265458.997617:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265458.997620:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997625:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fbbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.997677:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fbad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f855b expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.998830:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f855b expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265458.998842:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265458.998844:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265458.998847:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137800, rc 0) 00000100:00100000:2.0:1789265458.998957:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+49:10521:x1876180533823232:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 2348us (2664us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789265458.998983:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:3.0:1789265459.002072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265459.006956:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533823360 00000100:00100000:2.0:1789265459.006981:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533823360 00000100:00100000:2.0:1789265459.007167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:2.0:1789265459.007185:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+49:10521:x1876180533823360:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:2.0:1789265459.007293:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007315:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007347:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007395:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007404:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007412:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007419:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265459.007424:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007433:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007446:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265459.007464:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265459.007471:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.007477:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265459.008490:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+49:10521:x1876180533823360:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 1303us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265459.008503:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00080000:1.0:1789265459.020617:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265459.020964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265459.021050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533823616 00000100:00100000:2.0:1789265459.021063:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533823616 00000100:00100000:2.0:1789265459.021134:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:2.0:1789265459.021147:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+49:10521:x1876180533823616:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:2.0:1789265459.021522:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+50:10521:x1876180533823616:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 376us (566us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789265459.021531:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:0.0:1789265459.161583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265459.161991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533823872 00000100:00100000:3.0:1789265459.162015:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533823872 00000100:00100000:3.0:1789265459.164085:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:3.0:1789265459.164106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+50:10531:x1876180533823872:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265459.164143:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265459.164147:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265459.164184:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fb52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f853f expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.164208:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:3.0:1789265459.164233:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265459.164252:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fbd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8562 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.164450:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fbde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.164469:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fbde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.164482:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fbde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265459.164495:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789265459.165561:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fbd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8562 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.165588:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fbde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8562 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.165597:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265459.165617:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265459.165621:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885800, rc 0) 00000100:00100000:3.0:1789265459.165996:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+51:10531:x1876180533823872:12345-192.168.204.43@tcp:101:bash.0 Request processed in 1894us (4426us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789265459.166007:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:1.0:1789265459.174988:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265459.175396:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533824128 00000100:00100000:2.0:1789265459.175411:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533824128 00000100:00100000:2.0:1789265459.175553:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 105 00000100:00100000:2.0:1789265459.175567:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+51:10531:x1876180533824128:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:2.0:1789265459.175657:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789265459.175696:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef818fbde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8562 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.175725:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fbc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f855b expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.175765:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265459.175771:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265459.176402:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.176424:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.176439:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265459.176513:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789265459.176543:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001433c905 reply state 0000000092bd2517 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265459.176554:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265459.176813:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+52:10531:x1876180533824128:12345-192.168.204.43@tcp:36:bash.0 Request processed in 1245us (1836us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789265459.176822:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 105 00000020:00080000:2.0:1789265459.176829:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265459.187719:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.187745:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.187753:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.187761:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265459.187787:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.187797:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.187831:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265459.187835:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265459.187841:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.187849:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fbec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265459.191078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265459.191184:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533824256 00000100:00100000:3.0:1789265459.191199:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533824256 00000100:00100000:3.0:1789265459.191287:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 106 00000100:00100000:3.0:1789265459.191300:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+51:10531:x1876180533824256:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265459.191364:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265459.191402:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fbf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8569 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.191532:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.191550:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.191566:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265459.191607:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789265459.191612:0:9189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265459.191638:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.191670:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fbf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 53 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.191713:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 52 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.191724:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265459.191727:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265459.191732:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884000, rc 0) 00000100:00100000:3.0:1789265459.192839:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+52:10531:x1876180533824256:12345-192.168.204.43@tcp:101:bash.0 Request processed in 1531us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265459.192862:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 106 00000100:00100000:0.0:1789265459.203962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265459.206656:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533824512 00000100:00100000:1.0:1789265459.206747:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533824512 00000100:00100000:3.0:1789265459.207131:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:3.0:1789265459.207148:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+52:10531:x1876180533824512:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:1.0:1789265459.207167:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1789265459.207180:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1789265459.207529:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+53:10531:x1876180533824512:12345-192.168.204.43@tcp:35:bash.0 Request processed in 385us (3594us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789265459.207538:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:0.0:1789265459.349559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265459.349733:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533824640 00000100:00100000:3.0:1789265459.349746:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533824640 00000100:00100000:3.0:1789265459.349827:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 107 00000100:00100000:3.0:1789265459.349839:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+53:10537:x1876180533824640:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265459.349876:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265459.349907:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fc01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8570 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.350006:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818fc08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.350045:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818fc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.350060:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818fc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265459.350108:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789265459.350112:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265459.350147:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818fc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.350177:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fc01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8570 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.350199:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818fc08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8570 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.350209:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:3.0:1789265459.350213:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265459.350217:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:3.0:1789265459.350311:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:10537:x1876180533824640:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 474us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265459.350319:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 107 00000100:00100000:0.0:1789265459.358701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265459.360266:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533824768 00000100:00100000:2.0:1789265459.360285:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533824768 00000100:00100000:2.0:1789265459.360409:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 108 00000100:00100000:2.0:1789265459.360424:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:10537:x1876180533824768:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265459.360452:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265459.360490:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8577 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.360583:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.360603:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.360618:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.360636:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.360662:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.360669:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.360794:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fc24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.360804:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361204:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265459.361256:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789265459.361261:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265459.361286:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361301:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361309:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361317:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361324:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361405:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265459.361410:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361419:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361435:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265459.361439:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265459.361444:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361451:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fc16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361889:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361898:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361905:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361911:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265459.361971:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.361981:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.362002:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540ccf3700) 00010000:00010000:2.0:1789265459.362005:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265459.362008:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.362014:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fc1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.362060:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8577 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.362075:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fc24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8577 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.362081:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265459.362084:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265459.362086:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136200, rc 0) 00000100:00100000:2.0:1789265459.363007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10537:x1876180533824768:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 2577us (4313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265459.363018:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 108 00000100:00100000:1.0:1789265459.375483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265459.375708:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533824896 00000100:00100000:3.0:1789265459.375723:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533824896 00000100:00100000:3.0:1789265459.375812:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:3.0:1789265459.375834:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:2344:x1876180533824896:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265459.375854:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265459.375896:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fc24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8577 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.375929:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265459.375936:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265459.376012:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:2344:x1876180533824896:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 182us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265459.376021:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:0.0:1789265459.377196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265459.377738:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533825152 00000100:00100000:3.0:1789265459.377749:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533825152 00000100:00100000:3.0:1789265459.377869:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 109 00000100:00100000:3.0:1789265459.377884:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:10537:x1876180533825152:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265459.377910:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265459.378044:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fc2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f857e expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.378177:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.378194:0:9189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 55 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.378205:0:9189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.378927:0:9189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 55 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.378948:0:9189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 55 pid: 9189 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265459.378985:0:9189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553762816:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265459.379118:0:9189:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265459.392135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265459.392900:0:9189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553762816:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265459.392947:0:9189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265459.393094:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533825280 00000100:00100000:2.0:1789265459.393105:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533825280 00010000:00010000:2.0:1789265459.393155:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 56 pid: 9189 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265459.393206:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:2.0:1789265459.393218:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:2342:x1876180533825280:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265459.393267:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265459.393276:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 56 pid: 9189 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.393290:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 56 pid: 9189 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.393318:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef818fbfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8569 expref: 56 pid: 9189 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.393714:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265459.393721:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.393733:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.393742:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.393781:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265459.393847:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:2342:x1876180533825280:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 631us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265459.393857:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00010000:00010000:1.0:1789265459.394044:0:9189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.394053:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265459.394078:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789265459.394286:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef818fc2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 56 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.394304:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 55 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.394312:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265459.394315:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265459.394318:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884600, rc 0) 00000100:00100000:1.0:1789265459.394410:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10537:x1876180533825152:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 16529us (17222us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789265459.394418:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 109 00000100:00100000:1.0:1789265459.399142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265459.399238:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533825536 00000100:00100000:3.0:1789265459.399303:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533825536 00000100:00100000:3.0:1789265459.399660:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:3.0:1789265459.399675:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10537:x1876180533825536:12345-192.168.204.43@tcp:103:lfs.0 00010000:00010000:3.0:1789265459.399707:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265459.399746:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fb91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8554 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265459.399768:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265459.399775:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265459.399866:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:10537:x1876180533825536:12345-192.168.204.43@tcp:103:lfs.0 Request processed in 195us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265459.399875:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1789265459.411208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265459.415588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533825664 00000100:00100000:2.0:1789265459.416009:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533825664 00000100:00100000:2.0:1789265459.416323:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 110 00000100:00100000:2.0:1789265459.416650:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:10537:x1876180533825664:12345-192.168.204.43@tcp:58:lfs.0 00010000:00010000:2.0:1789265459.417039:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.417060:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265459.417074:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265459.418022:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789265459.418182:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:10537:x1876180533825664:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 1533us (6982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265459.418194:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 110 00000100:00100000:3.0:1789265459.421804:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265459.421951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533825792 00000100:00100000:1.0:1789265459.421965:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533825792 00000100:00100000:1.0:1789265459.422046:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 111 00000100:00100000:1.0:1789265459.422057:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10537:x1876180533825792:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265459.422085:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265459.422113:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8585 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.422196:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.422489:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8585 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.422514:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.422531:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8585 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.422551:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265459.422555:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265459.422559:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8585 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265459.422567:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5e800, rc 0) 00000100:00100000:1.0:1789265459.422647:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:10537:x1876180533825792:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 592us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265459.422655:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 111 00000100:00100000:2.0:1789265459.617224:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553762944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265459.617354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265459.617952:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553762944 00000100:00100000:3.0:1789265459.617964:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553762944 00000100:00100000:3.0:1789265459.618039:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265459.618051:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553762944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265459.618110:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000004:00080000:0.0:1789265459.618244:0:7152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 314851910679ns, next at 315851907389ns, rc = 0 00000100:00080000:1.0:1789265459.618773:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265459.618941:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553762944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 890us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265459.618951:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789265459.619044:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553762944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265459.742706:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265459.833565:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265459.833632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265459.833663:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265459.833736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265459.833747:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533826048 00000100:00100000:2.0:1789265459.833748:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533826176 00000100:00100000:2.0:1789265459.833765:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533826176 00000100:00100000:0.0:1789265459.833765:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533826048 00000100:00100000:1.0:1789265459.833774:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533826304 00000100:00100000:1.0:1789265459.833779:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533826304 00000100:00100000:3.0:1789265459.833877:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533825920 00000100:00100000:3.0:1789265459.833883:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533825920 00000100:00100000:3.0:1789265459.833931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 288 00000100:00100000:3.0:1789265459.833944:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533825920:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265459.834054:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533825920:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 112us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265459.834062:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 288 00000100:00100000:2.0:1789265459.834247:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:2.0:1789265459.834258:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2344:x1876180533826048:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265459.834269:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:3.0:1789265459.834289:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533826176:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265459.834320:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2344:x1876180533826048:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 65us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265459.834328:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:3.0:1789265459.834374:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533826176:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 46us (668us total) trans 0 rc 0/0 00000100:00080000:2.0:1789265459.834472:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265459.837828:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:1.0:1789265459.838148:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00100000:1.0:1789265459.838161:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533826304:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:2.0:1789265459.839257:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265459.839581:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533826304:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 1415us (5838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265459.839594:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 131 00000040:00080000:3.0:1789265459.998678:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265459.998692:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265459.998756:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789265459.998770:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265459.999613:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553763072:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265460.002508:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9dcc0 going to sleep for 10 seconds 00000100:00100000:0.0:1789265460.019409:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553763072:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265460.030522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265460.030634:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533826432 00000100:00100000:3.0:1789265460.030649:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533826432 00000100:00100000:3.0:1789265460.030736:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 112 00000100:00100000:3.0:1789265460.030748:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10538:x1876180533826432:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265460.030802:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265460.031629:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10538:x1876180533826432:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 878us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265460.031638:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 112 00000100:00100000:2.0:1789265460.041111:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.041408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533826560 00000100:00100000:1.0:1789265460.041424:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533826560 00000100:00100000:1.0:1789265460.041509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:1.0:1789265460.041524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10538:x1876180533826560:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789265460.041637:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.041661:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.041680:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042107:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042132:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042145:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042179:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042188:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042214:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265460.042259:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789265460.042263:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265460.042275:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042287:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042293:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042301:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042307:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265460.042515:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042525:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042538:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:1.0:1789265460.042540:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265460.042545:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042552:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042578:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042584:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042591:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042601:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265460.042604:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042611:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042619:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff92540cd7a300) 00010000:00010000:1.0:1789265460.042621:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265460.042623:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042630:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042644:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042651:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042656:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042667:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ec00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265460.042670:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042676:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042682:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265460.042684:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265460.042687:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.042693:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265460.042837:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10538:x1876180533826560:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 1313us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265460.042847:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:0.0:1789265460.051235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.052421:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533826816 00000100:00100000:1.0:1789265460.052438:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533826816 00000100:00100000:1.0:1789265460.052509:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:1.0:1789265460.052520:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:10538:x1876180533826816:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265460.052546:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265460.052570:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f858c expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052677:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052714:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052729:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265460.052743:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789265460.052851:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052859:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052867:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052873:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265460.052877:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052885:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052898:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265460.052901:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789265460.052906:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052913:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052955:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc63 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f858c expref: 57 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052971:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:1.0:1789265460.052973:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265460.052977:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fc63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f858c expref: 57 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.052987:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5ec00, rc 0) 00000100:00100000:1.0:1789265460.053064:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:10538:x1876180533826816:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 546us (1853us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789265460.053071:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:0.0:1789265460.062923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265460.063031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533826944 00000100:00100000:3.0:1789265460.063041:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533826944 00000100:00100000:0.0:1789265460.063272:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:0.0:1789265460.063285:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:10538:x1876180533826944:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265460.063429:0:9387:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265460.063624:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:10538:x1876180533826944:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 342us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265460.063639:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:2.0:1789265460.071971:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.072143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533827200 00000100:00100000:1.0:1789265460.072153:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533827200 00000100:00100000:1.0:1789265460.072216:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:1.0:1789265460.072227:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:10538:x1876180533827200:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265460.072246:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265460.072250:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789265460.072278:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef818fc08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8570 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.072300:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265460.072305:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265460.072319:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8593 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265460.072910:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789265460.074230:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.074264:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.074277:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.074392:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818fc78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8593 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.074413:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8593 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.074421:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92540cd7a300) 00010000:00010000:1.0:1789265460.074424:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265460.074427:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5fc00, rc 0) 00000100:00100000:1.0:1789265460.074499:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+57:10538:x1876180533827200:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 2273us (2537us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789265460.074507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:1.0:1789265460.083147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.083262:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533827456 00000100:00100000:2.0:1789265460.083274:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533827456 00000100:00100000:2.0:1789265460.083388:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:2.0:1789265460.083399:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+57:10538:x1876180533827456:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265460.083460:0:9189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265460.083488:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fc7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8593 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083511:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92540cd7a300) 00010000:00010000:2.0:1789265460.083522:0:9189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265460.083542:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083556:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083566:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083580:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083587:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083594:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083655:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083679:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083686:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083693:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265460.083698:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083706:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083714:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:2.0:1789265460.083717:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265460.083721:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083727:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fc8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083736:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083743:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083749:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083753:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265460.083762:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083768:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083776:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x95669c29 (ffff92540ccf3700) 00010000:00010000:2.0:1789265460.083778:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265460.083781:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.083786:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fc94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x95669c29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.083856:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:10538:x1876180533827456:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 458us (719us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265460.083864:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:3.0:1789265460.089302:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265460.089605:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533827584 00000100:00100000:0.0:1789265460.089616:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533827584 00000100:00100000:0.0:1789265460.089712:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:0.0:1789265460.089723:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:10538:x1876180533827584:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265460.089741:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265460.089764:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fc9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f859a expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.089800:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.089824:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.089836:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.089934:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fc9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 58 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.089954:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 57 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.089963:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:0.0:1789265460.089966:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265460.089969:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995200, rc 0) 00000100:00100000:0.0:1789265460.090036:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+57:10538:x1876180533827584:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 315us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265460.090049:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:0.0:1789265460.098593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.098667:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533827840 00000100:00100000:2.0:1789265460.098678:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533827840 00000100:00100000:2.0:1789265460.098731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:2.0:1789265460.098740:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+57:10538:x1876180533827840:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265460.098845:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.098864:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.098887:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265460.099126:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1789265460.099222:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084011193 reply state 00000000d3170135 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.099234:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265460.099317:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:10538:x1876180533827840:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 578us (733us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789265460.099325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:2.0:1789265460.104257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265460.104550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533827968 00000100:00100000:3.0:1789265460.104561:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533827968 00000100:00100000:3.0:1789265460.104624:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:3.0:1789265460.104635:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:10538:x1876180533827968:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265460.104658:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265460.104679:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.104740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.104755:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.104773:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:3.0:1789265460.104776:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265460.104781:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884a00, rc 0) 00000100:00100000:3.0:1789265460.104905:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:10538:x1876180533827968:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 272us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265460.104912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 120 00010000:00010000:1.0:1789265460.106782:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.106807:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.106816:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.106822:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265460.106851:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.106860:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.106886:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:1.0:1789265460.106889:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789265460.106894:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.106901:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fca9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265460.112553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.112716:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533828096 00000100:00100000:2.0:1789265460.112726:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533828096 00000100:00100000:2.0:1789265460.112785:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:2.0:1789265460.112795:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533828096:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789265460.113244:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2343:x1876180533828096:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 448us (698us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789265460.113253:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:0.0:1789265460.125765:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265460.125853:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533828352 00000100:00100000:3.0:1789265460.125886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533828352 00000100:00100000:3.0:1789265460.125942:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:3.0:1789265460.125952:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:10538:x1876180533828352:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265460.126201:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:10538:x1876180533828352:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 249us (444us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789265460.126209:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:1.0:1789265460.134507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265460.134712:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533828608 00000100:00100000:0.0:1789265460.134724:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533828608 00000100:00100000:0.0:1789265460.135028:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:0.0:1789265460.135040:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:10538:x1876180533828608:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265460.135240:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:10538:x1876180533828608:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 202us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265460.135248:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:0.0:1789265460.140061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.140226:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533828736 00000100:00100000:1.0:1789265460.140236:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533828736 00000100:00100000:1.0:1789265460.140299:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:1.0:1789265460.140309:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:10538:x1876180533828736:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265460.140377:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265460.140399:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818fcb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85a8 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.140472:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fcbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.140487:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.140499:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265460.140556:0:9189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265460.140574:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.140612:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818fcb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a8 expref: 62 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.140631:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fcbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a8 expref: 61 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.140639:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:1.0:1789265460.140643:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789265460.140647:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f000, rc 0) 00000100:00100000:1.0:1789265460.140716:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:10538:x1876180533828736:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 408us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265460.140723:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:1.0:1789265460.143719:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265460.143819:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533828864 00000100:00100000:0.0:1789265460.143830:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533828864 00000100:00100000:0.0:1789265460.143890:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:0.0:1789265460.143901:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2343:x1876180533828864:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265460.143919:0:9090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265460.143953:0:9090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85af expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265460.143982:0:9090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60633, blocks: 0x1 00010000:00010000:0.0:1789265460.144003:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1789265460.144008:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265460.144017:0:9090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 10 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.144061:0:9090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 10 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.144074:0:9090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995e00, rc 0) 00000100:00100000:0.0:1789265460.144143:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:2343:x1876180533828864:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 243us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265460.144151:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:2.0:1789265460.150456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.150559:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533829120 00000100:00100000:1.0:1789265460.150569:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533829120 00000100:00100000:1.0:1789265460.150627:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:1.0:1789265460.150637:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:10538:x1876180533829120:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789265460.150747:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:10538:x1876180533829120:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 111us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265460.150754:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:1.0:1789265460.161157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.161278:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533829248 00000100:00100000:2.0:1789265460.161299:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533829248 00000100:00100000:2.0:1789265460.161708:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:2.0:1789265460.161721:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:10538:x1876180533829248:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265460.161740:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265460.161759:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85b6 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.161794:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 11 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.161839:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265460.161843:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265460.161849:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.161886:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 11 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.161900:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 11 pid: 9090 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.161915:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437008700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1876180553763200:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265460.162016:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265460.172098:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437008700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1876180553763200:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265460.172142:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.172165:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136000, rc 0) 00000100:00100000:2.0:1789265460.172242:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:10538:x1876180533829248:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 10516us (11086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265460.172251:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1789265460.172757:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.173147:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533829376 00000100:00100000:2.0:1789265460.173156:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533829376 00010000:00010000:2.0:1789265460.173191:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 11 pid: 9090 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.173249:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:2.0:1789265460.173259:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254099fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:2342:x1876180533829376:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265460.173273:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265460.173307:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 11 pid: 9090 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.173322:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 11 pid: 9090 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.173374:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b81d6f4/0x8e12577ef818fcc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85af expref: 11 pid: 9090 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.173401:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265460.173406:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265460.173414:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 10 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.173425:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 10 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.173461:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 10 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.173476:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437008700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1876180553763328:192.168.204.43@tcp:105: 00000100:00100000:2.0:1789265460.173543:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265460.182833:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437008700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1876180553763328:192.168.204.43@tcp:105: 00010000:00010000:2.0:1789265460.182861:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265460.182928:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254099fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:2342:x1876180533829376:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 9669us (10171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265460.182939:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:1.0:1789265460.186463:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265460.186633:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533829504 00000100:00100000:0.0:1789265460.186643:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533829504 00002000:00100000:0.0:1789265460.186690:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff925402c48380 x1876180533829504/t0(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:31/0 lens 504/0 e 0 to 0 dl 1789265471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265460.186701:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925402c48380 with x1876180533829504 ext(0->12) 00002000:00010000:0.0:1789265460.186707:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925402c48380 00000100:00100000:0.0:1789265460.186738:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:0.0:1789265460.186748:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:2342:x1876180533829504:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265460.187188:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:2342:x1876180533829504:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 Request processed in 440us (735us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789265460.187197:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00002000:00100000:0.0:1789265460.187205:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff925402c48380 x1876180533829504/t4294967308(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:31/0 lens 504/448 e 0 to 0 dl 1789265471 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265460.187215:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925402c48380 with x1876180533829504 ext(0->12) 00002000:00010000:0.0:1789265460.187223:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925402c48380 00000100:00100000:0.0:1789265460.192137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.192720:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533829632 00000100:00100000:1.0:1789265460.192737:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533829632 00000100:00100000:1.0:1789265460.192851:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:1.0:1789265460.192862:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:10538:x1876180533829632:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789265460.274168:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:10538:x1876180533829632:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 81297us (82030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265460.274181:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 124 00000004:00080000:3.0:1789265460.274274:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1789265460.274296:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967383 is committed 00000004:00080000:3.0:1789265460.274310:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:3.0:1789265460.274326:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000001:00080000:3.0:1789265460.274374:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1789265460.274393:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789265460.274410:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92540a5c69c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789265460.274415:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543b574000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92540a5c6180 00000020:00080000:3.0:1789265460.274419:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543b574300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9253048b6000 00000001:00080000:3.0:1789265460.274451:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:3.0:1789265460.274476:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff925409d9d9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789265460.274479:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543ff31e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff925409d9d480 00000020:00080000:3.0:1789265460.274482:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543ff31500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92543b8fc000 00000020:00080000:3.0:1789265460.274608:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789265460.274783:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789265460.274810:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553763456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265460.274867:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265460.274944:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553763456 00000100:00100000:3.0:1789265460.274952:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553763456 00000100:00100000:3.0:1789265460.274999:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265460.275023:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876180553763456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789265460.275050:0:9090:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1789265460.275085:0:9090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa60631, atime: 0x6aa60631, ctime: 0x6aa60631, blocks: 0x1 00010000:00010000:3.0:1789265460.275093:0:9090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275111:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:3.0:1789265460.275115:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265460.275121:0:9090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275137:0:9090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275147:0:9090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275155:0:9090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275178:0:9090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265460.275637:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553763456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 616us (769us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789265460.275646:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789265460.275669:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789265460.275684:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265460.275691:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275705:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265460.275709:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275718:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275735:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275742:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba0c2a6/0x8e12577ef818fcd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.275761:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265460.275762:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265460.275764:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789265460.275799:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92543bfbed80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789265460.275805:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553763456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789265460.275957:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265460.275967:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553763584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789265460.275998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265460.276027:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553763584 00000100:00100000:2.0:1789265460.276032:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553763584 00000100:00100000:2.0:1789265460.276061:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265460.276068:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553763584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789265460.276084:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1789265460.276101:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.276117:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.276124:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789265460.276127:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265460.276130:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.276167:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.276180:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 11 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.276192:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543700ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1876180553763712:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265460.276239:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543b8b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265460.281563:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543700ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1876180553763712:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265460.281601:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265460.283679:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265460.283777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265460.284490:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533829760 00000100:00100000:3.0:1789265460.284503:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533829760 00000100:00100000:3.0:1789265460.284577:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:3.0:1789265460.284587:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:2343:x1876180533829760:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789265460.285364:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533829888 00000100:00100000:2.0:1789265460.285371:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533829888 00010000:00010000:2.0:1789265460.285402:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 13 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.285448:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:2.0:1789265460.285457:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:2343:x1876180533829888:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265460.285469:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265460.285474:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 13 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285488:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 13 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285512:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089c72f95/0x8e12577ef818fa95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8515 expref: 13 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285546:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265460.285550:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265460.285556:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285566:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285594:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265460.285651:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:2343:x1876180533829888:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 195us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265460.285658:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00010000:00010000:2.0:1789265460.285689:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285698:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285706:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285713:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.285729:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265460.286303:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1876180553763584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10233us (10301us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789265460.286312:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1789265460.286372:0:11652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265460.286378:0:11652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.286387:0:11652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137200 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265460.286392:0:11652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.286402:0:11652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.286417:0:11652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.286424:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c529b369/0x8e12577ef818fcda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.286442:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265460.286445:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265460.286446:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789265460.286481:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff925437008700/2, rc 0, transno 4294967309 00000100:00100000:2.0:1789265460.286495:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553763584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789265460.346368:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:2343:x1876180533829760:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 61748us (62555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265460.346382:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000001:00080000:1.0:1789265460.347375:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1789265460.347395:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789265460.347407:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1789265460.351319:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265460.351429:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533830144 00000100:00100000:3.0:1789265460.351440:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533830144 00000100:00100000:3.0:1789265460.351502:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 125 00000100:00100000:3.0:1789265460.351514:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:10538:x1876180533830144:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265460.351571:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265460.351611:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fcbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a8 expref: 15 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.351633:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:3.0:1789265460.351638:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265460.351669:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.351682:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.351693:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265460.351984:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db79b3ed reply state 00000000c79e0c37 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265460.351994:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265460.352096:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:10538:x1876180533830144:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 583us (785us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789265460.352103:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 125 00010000:00010000:2.0:1789265460.355179:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.355219:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.355226:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.355244:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265460.355249:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.355257:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.355273:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:2.0:1789265460.355276:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265460.355280:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.355285:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818fce1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265460.357844:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.358391:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533830272 00000100:00100000:2.0:1789265460.358401:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533830272 00000100:00100000:2.0:1789265460.358460:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:2.0:1789265460.358470:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533830272:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789265460.358668:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789265460.358672:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789265458 00002000:00010000:2.0:1789265460.358674:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789265457 00002000:00010000:2.0:1789265460.358677:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789265459 -> 1789265458 00002000:00010000:2.0:1789265460.358692:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789265460.358740:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533830272:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 272us (905us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789265460.358749:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:3.0:1789265460.362808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.363118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533830528 00000100:00100000:1.0:1789265460.363128:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533830528 00000100:00100000:1.0:1789265460.363190:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:1.0:1789265460.363200:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:10538:x1876180533830528:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789265460.363280:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.363298:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 15 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.363308:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.363394:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 15 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.363409:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 15 pid: 9387 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265460.363423:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c49180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553763840:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265460.363512:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265460.369055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265460.369200:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533830656 00000100:00100000:3.0:1789265460.369209:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533830656 00010000:00010000:3.0:1789265460.369261:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 16 pid: 9387 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265460.369306:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:3.0:1789265460.369316:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:2343:x1876180533830656:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265460.369382:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265460.369391:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 16 pid: 9387 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.369407:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 16 pid: 9387 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.369432:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:3.0:1789265460.369438:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.369448:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.369456:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.369476:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265460.369529:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:2343:x1876180533830656:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 214us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265460.369537:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00010000:00010000:1.0:1789265460.370464:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fca2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f859a expref: 15 pid: 9387 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265460.370487:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c49180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553763840:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265460.370511:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370520:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370526:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370556:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370563:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370571:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370577:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265460.370582:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370590:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370615:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:1.0:1789265460.370619:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789265460.370641:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.370648:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265460.370711:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10538:x1876180533830528:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 Request processed in 7512us (7922us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789265460.370720:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:0.0:1789265460.374839:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265460.374939:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533830784 00000100:00100000:3.0:1789265460.374969:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533830784 00000100:00100000:3.0:1789265460.375034:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:3.0:1789265460.375046:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533830784:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789265460.375095:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.375117:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.375127:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265460.375131:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265460.375135:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.375171:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.375187:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 7 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265460.375203:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1876180553763968:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265460.375302:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265460.382104:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1876180553763968:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265460.382136:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265460.383711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.383858:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533830912 00000100:00100000:2.0:1789265460.383867:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533830912 00010000:00010000:2.0:1789265460.383906:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 8 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.383962:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:2.0:1789265460.383971:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533830912:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265460.383986:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265460.384011:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 8 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.384025:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 8 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.384049:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ffd399d/0x8e12577ef818fccc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85b6 expref: 8 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.384069:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265460.384074:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265460.384080:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.384089:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.384136:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265460.384282:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.384293:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.384316:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.384325:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.384377:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.384396:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265460.384400:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.384409:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.384421:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.384429:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068cf4403/0x8e12577ef818fcef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.384835:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533830912:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 862us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265460.384843:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:0.0:1789265460.385022:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533830784:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 9978us (10194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265460.385031:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:0.0:1789265460.389845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.389934:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533831168 00000100:00100000:2.0:1789265460.389953:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533831168 00000100:00100000:2.0:1789265460.390583:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 127 00000100:00100000:2.0:1789265460.390607:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10538:x1876180533831168:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789265460.390702:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.390720:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.390732:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.391245:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.391258:0:9387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.391267:0:9387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.391304:0:9387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.391379:0:9387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 15 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.391395:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437009180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553764096:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265460.391483:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a847300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265460.400494:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.400983:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437009180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553764096:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265460.401011:0:9387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265460.401201:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533831296 00000100:00100000:3.0:1789265460.401208:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533831296 00010000:00010000:3.0:1789265460.401308:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 16 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265460.401462:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:3.0:1789265460.401473:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:2343:x1876180533831296:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265460.401490:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265460.401497:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 16 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.401509:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 16 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.401532:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fcb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85a1 expref: 16 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.401550:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:3.0:1789265460.401555:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.401565:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.401572:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.401618:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265460.401678:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:2343:x1876180533831296:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 206us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265460.401695:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00010000:00010000:1.0:1789265460.402629:0:9387:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.402640:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265460.402846:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789265460.403073:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789265460.403121:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789265460.403208:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9387:1876180553764224:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789265460.403493:0:9387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265460.403529:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265460.404433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553764224 00000100:00100000:1.0:1789265460.404443:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553764224 00000100:00100000:1.0:1789265460.404492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265460.404501:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9387:x1876180553764224:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789265460.404880:0:9387:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789265460.404887:0:9387:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92543775e300, transno 4294967303 00000004:00080000:2.0:1789265460.404900:0:9387:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1789265460.404929:0:9387:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff925437008700 x1876180553763584/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789265476 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265460.404941:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9387:1876180553764224:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789265460.405302:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9387:x1876180553764224:12345-0@lo:1000:mdt00_004.0 Request processed in 801us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265460.405310:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:2.0:1789265460.405634:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1789265460.405703:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437009180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9387:1876180553764352:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789265460.405758:0:9387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265460.405788:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a8470c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265460.406064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553764352 00000100:00100000:3.0:1789265460.406071:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553764352 00000100:00100000:3.0:1789265460.406100:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265460.406108:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9387:x1876180553764352:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789265460.406377:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9387:x1876180553764352:12345-0@lo:1000:mdt00_004.0 Request processed in 269us (618us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789265460.406383:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265460.406590:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437009180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9387:1876180553764352:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789265460.406629:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406640:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406662:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406669:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265460.406673:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406682:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406698:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92542b074e00) 00010000:00010000:2.0:1789265460.406701:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265460.406706:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406712:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fcfd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406744:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406750:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406756:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406760:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265460.406763:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406778:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.406786:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265460.406788:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265460.407300:0:9387:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8585 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.407314:0:9387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8585 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.407323:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8585 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.407449:0:9387:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8585 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.407463:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543700bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553764480:192.168.204.43@tcp:105: 00000100:00100000:2.0:1789265460.407532:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d87b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265460.413929:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543700bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553764480:192.168.204.43@tcp:105: 00010000:00010000:2.0:1789265460.413974:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.413985:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fc40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414019:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414048:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414060:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414072:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414077:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414084:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414089:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265460.414093:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414100:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414111:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265460.414114:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265460.414117:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414122:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414132:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414143:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414149:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414154:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265460.414157:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414163:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414172:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:2.0:1789265460.414174:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265460.414177:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.414183:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fcf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265460.414467:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:10538:x1876180533831168:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 23874us (24629us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789265460.414478:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 127 00000020:00080000:2.0:1789265460.414484:0:9387:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265460.414928:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265460.414934:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265460.415500:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789265460.415509:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265460.418749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.418854:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533831424 00000100:00100000:1.0:1789265460.418880:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533831424 00000100:00100000:1.0:1789265460.418938:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:1.0:1789265460.418959:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:10537:x1876180533831424:12345-192.168.204.43@tcp:49:lfs.0 00000100:00100000:1.0:1789265460.419104:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:10537:x1876180533831424:12345-192.168.204.43@tcp:49:lfs.0 Request processed in 148us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265460.419112:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:3.0:1789265460.423594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265460.423714:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533831680 00000100:00100000:2.0:1789265460.423725:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533831680 00000100:00100000:2.0:1789265460.423783:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:2.0:1789265460.423792:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:10538:x1876180533831680:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789265460.424456:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789265460.424549:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789265460.424589:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.424617:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.424629:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.424637:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.424644:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.424651:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265460.424681:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265460.424769:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:10538:x1876180533831680:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 976us (1182us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789265460.424777:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 32 00000020:00080000:2.0:1789265460.424783:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265460.425954:0:11651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265460.425964:0:11651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.425973:0:11651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265460.425977:0:11651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.425986:0:11651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.426004:0:11651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92540ccf3700) 00010000:00010000:3.0:1789265460.426006:0:11651:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789265460.426011:0:11651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.426017:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fd0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265460.426053:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265460.426055:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265460.426057:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265460.434928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265460.435888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533831936 00000100:00100000:0.0:1789265460.435902:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533831936 00000100:00100000:1.0:1789265460.436203:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 128 00000100:00100000:1.0:1789265460.436214:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:10537:x1876180533831936:12345-192.168.204.43@tcp:58:lfs.0 00000040:00080000:1.0:1789265460.436638:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789265460.436767:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:10537:x1876180533831936:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 553us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265460.436775:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 128 00000100:00100000:0.0:1789265460.504281:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.504390:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533832064 00000100:00100000:1.0:1789265460.504400:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533832064 00000100:00100000:1.0:1789265460.504463:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 129 00000100:00100000:1.0:1789265460.504474:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:10540:x1876180533832064:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265460.504506:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265460.504529:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fd12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.504591:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.504605:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.504616:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.504647:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.504656:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.504664:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.505161:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.505174:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 21 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.505183:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.505217:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 21 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.506480:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 21 pid: 9189 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265460.506503:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553764608:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265460.506697:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265460.513112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265460.513253:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553764608:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265460.513280:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265460.513538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533832320 00000100:00100000:3.0:1789265460.513544:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533832320 00000100:00100000:3.0:1789265460.513598:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:3.0:1789265460.513616:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:5585:x1876180533832320:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789265460.513841:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:5585:x1876180533832320:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 226us (737us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789265460.513849:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:2.0:1789265460.517982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265460.518156:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533832448 00000100:00100000:0.0:1789265460.518166:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533832448 00010000:00010000:0.0:1789265460.518208:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 23 pid: 9189 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265460.518253:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:0.0:1789265460.518263:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:2342:x1876180533832448:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265460.518279:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265460.518286:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 23 pid: 9189 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.518298:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 23 pid: 9189 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.518320:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fc32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f857e expref: 23 pid: 9189 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.518375:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:0.0:1789265460.518381:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.518390:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.518397:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265460.518431:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265460.518495:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:2342:x1876180533832448:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 232us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265460.518518:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00010000:00010000:1.0:1789265460.518602:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518620:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265460.518667:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789265460.518672:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265460.518889:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518905:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518916:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518923:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518930:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518936:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265460.518941:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518947:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518956:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265460.518966:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265460.518970:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518977:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518990:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.518996:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.519002:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.519008:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265460.519010:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.519016:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.519023:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92540cd7a800) 00010000:00010000:1.0:1789265460.519025:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265460.519028:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.519033:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.519075:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fd12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85bd expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.519101:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85bd expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265460.519109:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265460.519111:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265460.519113:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5e600, rc 0) 00000100:00100000:1.0:1789265460.519253:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10540:x1876180533832064:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 14781us (15039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265460.519261:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 129 00010000:00010000:0.0:1789265460.767020:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265461.470608:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265461.470623:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265461.470691:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789265461.470699:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265461.470897:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e71c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553764736:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265461.471071:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265461.476464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265461.476571:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533832576 00000100:00100000:3.0:1789265461.476584:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533832576 00000100:00100000:3.0:1789265461.476666:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 130 00000100:00100000:3.0:1789265461.476680:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:10552:x1876180533832576:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265461.476735:0:9387:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265461.476905:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:10552:x1876180533832576:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 229us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265461.476915:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 130 00000100:00080000:3.0:1789265461.476951:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265461.477308:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e71c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553764736:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265461.485237:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265461.486437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533832832 00000100:00100000:1.0:1789265461.486458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533832832 00000100:00100000:1.0:1789265461.486546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00100000:1.0:1789265461.486558:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:10552:x1876180533832832:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265461.486588:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265461.486619:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fd2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.486770:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.486791:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.486809:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265461.486825:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789265461.487045:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fd2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85c4 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.487067:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85c4 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.487077:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265461.487081:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265461.487085:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f200, rc 0) 00000100:00100000:1.0:1789265461.487190:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:10552:x1876180533832832:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 633us (1965us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789265461.487199:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00100000:1.0:1789265461.505016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265461.505123:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265461.505163:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533833216 00000100:00100000:1.0:1789265461.505177:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533833216 00000100:00100000:1.0:1789265461.505249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 132 00000100:00100000:1.0:1789265461.505262:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:10552:x1876180533833216:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265461.506014:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.506039:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.506055:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.507023:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.507056:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.507064:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.507070:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265461.507076:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.507085:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265461.508858:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533832960 00000100:00100000:3.0:1789265461.508877:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533832960 00000100:00100000:3.0:1789265461.509078:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:3.0:1789265461.509093:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:2342:x1876180533832960:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265461.509116:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265461.511068:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818fd35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85c4 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265461.511101:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265461.511109:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265461.511215:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:2342:x1876180533832960:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 2124us (6215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265461.511227:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00010000:00010000:1.0:1789265461.514316:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265461.514459:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265461.514473:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265461.514487:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef818fd43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265461.514972:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:10552:x1876180533833216:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 9704us (9839us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789265461.514985:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 132 00000040:00080000:3.0:1789265461.515531:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265461.515538:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265461.516042:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789265461.516055:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265461.525243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265461.525620:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533833472 00000100:00100000:3.0:1789265461.525635:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533833472 00000100:00100000:3.0:1789265461.525705:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:3.0:1789265461.525717:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:10552:x1876180533833472:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265461.526053:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:10552:x1876180533833472:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 338us (826us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789265461.526063:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00010000:00010000:3.0:1789265461.790516:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265461.864188:0:12094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265461.864200:0:12094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265461.864244:0:12094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789265461.864250:0:12094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265462.147691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265462.147832:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533833728 00000100:00100000:3.0:1789265462.147843:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533833728 00000100:00100000:3.0:1789265462.147908:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 133 00000100:00100000:3.0:1789265462.147918:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:10565:x1876180533833728:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265462.147942:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265462.147963:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85cb expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.148087:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fd51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.148101:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fd51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.148114:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fd51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265462.148125:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789265462.148274:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85cb expref: 27 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.148295:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fd51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85cb expref: 26 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.148304:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265462.148307:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789265462.148320:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884600, rc 0) 00000100:00100000:3.0:1789265462.148462:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:10565:x1876180533833728:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 544us (778us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789265462.148471:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 133 00000100:00100000:1.0:1789265462.152986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265462.153107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533833856 00000100:00100000:3.0:1789265462.153118:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533833856 00000100:00100000:3.0:1789265462.153187:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 134 00000100:00100000:3.0:1789265462.153271:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:10565:x1876180533833856:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:3.0:1789265462.153377:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153539:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153551:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153580:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153587:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153593:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153599:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265462.153604:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153612:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153623:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:3.0:1789265462.153627:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265462.153632:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265462.153638:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fd5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265462.153768:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:10565:x1876180533833856:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 492us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265462.153782:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 134 00000100:00100000:3.0:1789265462.175008:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553764864:0@lo:400:kworker.0 00000100:00100000:3.0:1789265462.175091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.175294:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553764864 00000100:00100000:1.0:1789265462.175302:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553764864 00000100:00100000:1.0:1789265462.175913:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789265462.175924:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553764864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.178452:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553764992:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.178519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.191011:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553764864:12345-0@lo:400:kworker.0 Request processed in 15078us (15908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265462.191043:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789265462.191125:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553764992 00000100:00100000:1.0:1789265462.191135:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553764992 00000100:00100000:1.0:1789265462.191174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789265462.191182:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553764992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265462.191276:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553764992:12345-0@lo:400:kworker.0 Request processed in 94us (12755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265462.191284:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789265462.191995:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553764992:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193357:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553765120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265462.193464:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265462.193470:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553765248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265462.193544:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553765248 00000100:00100000:2.0:1789265462.193550:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553765248 00000100:00100000:2.0:1789265462.193606:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789265462.193615:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553765248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193660:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553765248:12345-0@lo:400:kworker.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265462.193667:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789265462.193685:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265462.193698:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553765120 00000100:00100000:2.0:1789265462.193701:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553765120 00000100:00100000:2.0:1789265462.193728:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789265462.193734:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553765120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193774:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553765120:12345-0@lo:400:kworker.0 Request processed in 40us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265462.193781:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1789265462.193794:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265462.193817:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553765248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193826:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553765120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193854:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553765504:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265462.193915:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265462.193922:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553765376:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.193942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265462.193967:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553765504 00000100:00100000:2.0:1789265462.193971:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553765504 00000100:00100000:2.0:1789265462.194006:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789265462.194012:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553765504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.194047:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553765504:12345-0@lo:400:kworker.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265462.194053:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789265462.194070:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265462.194086:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553765504:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.194106:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553765376 00000100:00100000:2.0:1789265462.194109:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553765376 00000100:00100000:2.0:1789265462.194138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789265462.194145:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553765376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.194180:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553765376:12345-0@lo:400:kworker.0 Request processed in 35us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265462.194186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789265462.194215:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265462.194231:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553765376:0@lo:400:kworker.0 00000100:00100000:3.0:1789265462.207053:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553764864:0@lo:400:kworker.0 00000100:00100000:2.0:1789265462.352111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265462.353631:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533833984 00000100:00100000:0.0:1789265462.353645:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533833984 00000100:00100000:0.0:1789265462.353745:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00080000:2.0:1789265462.353855:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265462.353904:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533833984:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:0.0:1789265462.353927:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265462.353953:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef818fd66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85d2 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265462.353985:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa60632, atime: 0x6aa60631, ctime: 0x6aa60632, blocks: 0xb 00010000:00010000:0.0:1789265462.354005:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=317s v=(0 0) 00010000:00010000:0.0:1789265462.354026:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265462.354036:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef818fd66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d2 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265462.354059:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef818fd66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d2 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265462.354073:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995800, rc 0) 00000100:00100000:0.0:1789265462.354148:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2344:x1876180533833984:12345-192.168.204.43@tcp:101:cat.0 Request processed in 393us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.354155:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:1.0:1789265462.369234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265462.369412:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533834112 00000100:00100000:3.0:1789265462.369423:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533834112 00002000:00100000:3.0:1789265462.369475:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff925437500e00 x1876180533834112/t0(0) o3->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:33/0 lens 488/0 e 0 to 0 dl 1789265473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265462.369486:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925437500e00 with x1876180533834112 ext(0->4095) 00002000:00010000:3.0:1789265462.369492:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925437500e00 00000100:00100000:3.0:1789265462.369516:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:3.0:1789265462.369526:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533834112:12345-192.168.204.43@tcp:3:cat.0 00000100:00100000:3.0:1789265462.369884:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533834112:12345-192.168.204.43@tcp:3:cat.0 Request processed in 357us (660us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789265462.369892:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00002000:00100000:3.0:1789265462.369900:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff925437500e00 x1876180533834112/t0(0) o3->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:33/0 lens 488/4536 e 0 to 0 dl 1789265473 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265462.369907:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925437500e00 with x1876180533834112 ext(0->4095) 00002000:00010000:3.0:1789265462.369911:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925437500e00 00000100:00100000:3.0:1789265462.688729:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553765632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265462.688820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.689095:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553765632 00000100:00100000:1.0:1789265462.689104:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553765632 00000100:00100000:1.0:1789265462.689158:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265462.689168:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553765632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265462.689203:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265462.699237:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553765632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265462.707126:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553765632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17949us (18294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265462.707141:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000001:00080000:0.0:1789265462.752380:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789265462.752401:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1789265462.752412:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1789265462.815788:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265463.838534:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789265464.737475:0:7152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319971140169ns, next at 320971136994ns, rc = 0 00000100:00100000:3.0:1789265464.737555:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265464.737580:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bbdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553765760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265464.737669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265464.738182:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553765760 00000100:00100000:0.0:1789265464.738190:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553765760 00000100:00100000:0.0:1789265464.738270:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265464.738284:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553765760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265464.738319:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265464.738405:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553765760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265464.738412:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265464.738473:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bbdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553765760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265464.738551:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265464.862701:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265464.959484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265464.959535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265464.959581:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265464.959604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265464.959636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265464.959670:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533834624 00000100:00100000:1.0:1789265464.959682:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533834624 00000100:00100000:1.0:1789265464.959769:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533834496 00000100:00100000:1.0:1789265464.959773:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533834496 00000100:00100000:1.0:1789265464.959804:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:1.0:1789265464.959831:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2344:x1876180533834624:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265464.959906:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2344:x1876180533834624:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 78us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265464.959914:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:1.0:1789265464.959935:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:1.0:1789265464.959941:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2344:x1876180533834496:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265464.960108:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2344:x1876180533834496:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 166us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265464.960116:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:1.0:1789265464.960137:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533834368 00000100:00100000:1.0:1789265464.960142:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533834368 00000100:00100000:1.0:1789265464.960169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533834752 00000100:00100000:1.0:1789265464.960172:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533834752 00000100:00100000:1.0:1789265464.960194:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 135 00000100:00100000:1.0:1789265464.960201:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:2344:x1876180533834368:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265464.960234:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:2344:x1876180533834368:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265464.960242:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 135 00000100:00100000:1.0:1789265464.960254:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 136 00000100:00100000:1.0:1789265464.960274:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533834752:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265464.960317:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2344:x1876180533834752:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 44us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265464.960325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 136 00000100:00080000:1.0:1789265464.960372:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265464.960383:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265464.960385:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265464.961672:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533834240 00000100:00100000:3.0:1789265464.961685:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533834240 00000100:00100000:3.0:1789265464.961784:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 290 00000100:00100000:3.0:1789265464.961794:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533834240:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265464.961862:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533834240:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 69us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265464.961870:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 290 00000004:00080000:3.0:1789265465.365880:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:1.0:1789265465.366217:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bbdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553765888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789265465.366300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265465.366473:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553765888 00000100:00100000:0.0:1789265465.366496:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553765888 00000100:00100000:0.0:1789265465.366539:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265465.366547:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553765888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789265465.367094:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789265465.367100:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789265458 -> 1789265458 00002000:00010000:0.0:1789265465.367103:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1789265457 -> 1789265457 00002000:00010000:0.0:1789265465.367105:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789265458 -> 1789265458 00002000:00010000:0.0:1789265465.367107:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000001:00080000:3.0:1789265465.367267:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:3.0:1789265465.367294:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92540a847480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789265465.367298:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543b574f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92540a847300 00000020:00080000:3.0:1789265465.367302:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543b574400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff925409c56400 00000001:00080000:3.0:1789265465.367318:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789265465.367347:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789265465.367361:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789265465.367551:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1789265465.367633:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1876180553765888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1084us (1330us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789265465.367642:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1789265465.368088:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92543bbdce00/2, rc 0, transno 4294967312 00000100:00100000:1.0:1789265465.368096:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bbdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553765888:0@lo:2:osp-syn-0-0.0 00000040:00080000:2.0:1789265465.630766:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265465.630776:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265465.630837:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789265465.630848:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789265465.786853:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1789265465.786869:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:3.0:1789265465.886544:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265466.911622:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265467.298753:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553766272:0@lo:400:kworker.0 00000100:00100000:1.0:1789265467.298847:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553766400:0@lo:400:kworker.0 00000100:00100000:1.0:1789265467.298924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265467.299008:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265467.299015:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553766016:0@lo:400:kworker.0 00000100:00100000:1.0:1789265467.299046:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265467.299071:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553766528:0@lo:400:kworker.0 00000100:00100000:1.0:1789265467.299105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265467.299139:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553766400 00000100:00100000:1.0:1789265467.299147:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553766400 00000100:00100000:1.0:1789265467.299205:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265467.299226:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553766400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265467.299279:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553766400:12345-0@lo:400:kworker.0 Request processed in 67us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265467.299287:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265467.299312:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553766016 00000100:00100000:1.0:1789265467.299316:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553766016 00000100:00100000:1.0:1789265467.299371:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789265467.299377:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553766016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265467.299404:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553766016:12345-0@lo:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265467.299419:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:1.0:1789265467.299446:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265467.299476:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553766016:0@lo:400:kworker.0 00000100:00100000:1.0:1789265467.299487:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789265467.299492:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff925437008700, transno 4294967309 00000004:00080000:1.0:1789265467.299503:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967312 00000004:00080000:1.0:1789265467.299519:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92543bbdce00, transno 4294967312 00000100:00100000:1.0:1789265467.299523:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553766400:0@lo:400:kworker.0 00000100:00100000:0.0:1789265467.300362:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553766144:0@lo:400:kworker.0 00000100:00100000:0.0:1789265467.300406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265467.300430:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553766656:0@lo:400:kworker.0 00000100:00100000:0.0:1789265467.300452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265467.300491:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553766528 00000100:00100000:0.0:1789265467.300497:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553766528 00000100:00100000:0.0:1789265467.300537:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553766144 00000100:00100000:0.0:1789265467.300539:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553766144 00000100:00100000:0.0:1789265467.300558:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265467.300565:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553766528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265467.300611:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553766528:12345-0@lo:400:kworker.0 Request processed in 46us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265467.300619:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265467.300634:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789265467.300641:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553766144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265467.300685:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553766144:12345-0@lo:400:kworker.0 Request processed in 46us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265467.300692:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789265467.300710:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553766656 00000100:00100000:0.0:1789265467.300713:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553766656 00000100:00100000:0.0:1789265467.300739:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789265467.300745:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553766656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265467.300789:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553766656:12345-0@lo:400:kworker.0 Request processed in 45us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265467.300796:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789265467.300820:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265467.300824:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265467.300846:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553766144:0@lo:400:kworker.0 00000100:00100000:0.0:1789265467.300855:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789265467.300861:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789265467.300879:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92543bfbed80, transno 4294967304 00000100:00100000:0.0:1789265467.300890:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553766656:0@lo:400:kworker.0 00000100:00100000:0.0:1789265467.300915:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553766528:0@lo:400:kworker.0 00000100:00100000:3.0:1789265467.301649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265467.301737:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553766272 00000100:00100000:2.0:1789265467.301743:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553766272 00000100:00100000:2.0:1789265467.301800:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789265467.301808:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553766272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265467.301861:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553766272:12345-0@lo:400:kworker.0 Request processed in 55us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265467.301868:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265467.302480:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553766272:0@lo:400:kworker.0 00000100:00080000:0.0:1789265467.302595:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265467.808945:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265467.808970:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553766784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265467.809044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265467.809294:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553766784 00000100:00100000:2.0:1789265467.809303:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553766784 00000100:00100000:2.0:1789265467.809376:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265467.809385:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553766784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265467.809419:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265467.809463:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553766784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265467.809470:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265467.809600:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553766784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265467.934579:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265468.961744:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265469.564965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265469.565105:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533834880 00000100:00100000:0.0:1789265469.565120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533834880 00000100:00100000:0.0:1789265469.565236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 135 00000100:00100000:0.0:1789265469.565249:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:10217:x1876180533834880:12345-192.168.204.43@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789265469.565424:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:10217:x1876180533834880:12345-192.168.204.43@tcp:60:lhsmtool_posix.0 Request processed in 178us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265469.565448:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 135 00000100:00080000:1.0:1789265469.565889:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265469.572411:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265469.574523:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533835136 00000100:00100000:3.0:1789265469.574545:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533835136 00000100:00100000:3.0:1789265469.574659:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:3.0:1789265469.574671:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:10217:x1876180533835136:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265469.575450:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:10217:x1876180533835136:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 777us (3054us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789265469.575460:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:1.0:1789265469.855276:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553766912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265469.855400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265469.855623:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553766912 00000100:00100000:0.0:1789265469.855635:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553766912 00000100:00100000:0.0:1789265469.855730:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789265469.855741:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553766912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265469.855800:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265469.855878:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553766912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265469.855886:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1789265469.856378:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265469.856429:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553766912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265469.982545:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265469.991079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265469.991218:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533835264 00000100:00100000:2.0:1789265469.991234:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533835264 00000100:00100000:2.0:1789265469.991380:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 136 00000100:00100000:2.0:1789265469.991393:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:11017:x1876180533835264:12345-192.168.204.43@tcp:101:lsof.0 00010000:00010000:2.0:1789265469.991422:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265469.991462:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fd6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265469.991556:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265469.991588:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265469.991613:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265469.991663:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265469.991666:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265469.991716:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265469.991746:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fd6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265469.991766:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265469.991777:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:2.0:1789265469.991780:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265469.991783:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137a00, rc 0) 00000100:00100000:2.0:1789265469.991878:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:11017:x1876180533835264:12345-192.168.204.43@tcp:101:lsof.0 Request processed in 488us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265469.991886:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 136 00000100:00080000:1.0:1789265469.993608:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265470.070506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265470.070573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265470.070602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265470.070645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265470.070701:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533835776 00000100:00100000:1.0:1789265470.070711:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533835776 00000100:00100000:1.0:1789265470.070774:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533835648 00000100:00100000:1.0:1789265470.070777:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533835648 00000100:00100000:1.0:1789265470.070807:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:1.0:1789265470.070818:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533835776:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265470.070890:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533835776:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 73us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265470.070898:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:1.0:1789265470.070931:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:1.0:1789265470.070938:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533835648:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265470.070963:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533835648:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265470.070970:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00080000:1.0:1789265470.070993:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265470.070998:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265470.071050:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533835392 00000100:00100000:2.0:1789265470.071065:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533835392 00000100:00100000:2.0:1789265470.071145:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 292 00000100:00100000:2.0:1789265470.071171:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533835392:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265470.071264:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533835392:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 108us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265470.071286:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 292 00000100:00100000:0.0:1789265470.072877:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533835520 00000100:00100000:0.0:1789265470.072889:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533835520 00000100:00100000:0.0:1789265470.073178:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 140 00000100:00100000:0.0:1789265470.073191:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2345:x1876180533835520:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265470.073276:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2345:x1876180533835520:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 85us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265470.073285:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 140 00000001:00080000:3.0:1789265470.433058:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789265470.433079:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789265470.433521:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789265470.433536:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1789265471.006935:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265472.030570:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265472.416529:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553767296:0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.416617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265472.416686:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789265472.416693:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553767168:0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.416732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265472.416751:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553767680:0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.416776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265472.416815:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553767296 00000100:00100000:1.0:1789265472.416823:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553767296 00000100:00100000:1.0:1789265472.417099:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553767168 00000100:00100000:1.0:1789265472.417104:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553767168 00000100:00100000:1.0:1789265472.417140:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265472.417149:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553767296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.417204:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553767296:12345-0@lo:400:kworker.0 Request processed in 56us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265472.417212:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265472.417228:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789265472.417234:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553767168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.417261:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553767168:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265472.417266:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1789265472.417285:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265472.417315:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553767168:0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.417326:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553767296:0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.417379:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553767680 00000100:00100000:1.0:1789265472.417383:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553767680 00000100:00100000:2.0:1789265472.417660:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553767040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265472.417696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265472.417741:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553767552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265472.417766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265472.417785:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265472.417791:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553767424:0@lo:400:kworker.0 00000100:00100000:2.0:1789265472.417813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265472.417843:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553767424 00000100:00100000:2.0:1789265472.417847:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553767424 00000100:00100000:2.0:1789265472.417901:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789265472.417908:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553767424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265472.417946:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553767424:12345-0@lo:400:kworker.0 Request processed in 38us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265472.417953:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789265472.417968:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265472.417986:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553767424:0@lo:400:kworker.0 00000100:00100000:2.0:1789265472.418029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553767552 00000100:00100000:2.0:1789265472.418033:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553767552 00000100:00100000:2.0:1789265472.418061:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789265472.418068:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553767552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265472.418104:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553767552:12345-0@lo:400:kworker.0 Request processed in 37us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265472.418123:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1789265472.418148:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265472.418164:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553767552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265472.418197:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553767040 00000100:00100000:2.0:1789265472.418201:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553767040 00000100:00100000:2.0:1789265472.418225:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789265472.418231:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553767040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265472.418265:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3305:x1876180553767040:12345-0@lo:400:kworker.0 Request processed in 34us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265472.418272:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789265472.418313:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553767040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.419276:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265472.419287:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553767680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265472.419373:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553767680:12345-0@lo:400:kworker.0 Request processed in 89us (2596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265472.419380:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265472.419807:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553767680:0@lo:400:kworker.0 00000100:00080000:2.0:1789265472.422428:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265472.928619:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265472.928644:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553767808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265472.928721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265472.929082:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553767808 00000100:00100000:2.0:1789265472.929090:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553767808 00000100:00100000:2.0:1789265472.929178:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265472.929188:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553767808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265472.929224:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265472.929286:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553767808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265472.929293:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265472.929796:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553767808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265473.054972:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265474.078756:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265474.978133:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553767936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265474.978260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265474.978668:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553767936 00000100:00100000:3.0:1789265474.978679:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553767936 00000100:00100000:3.0:1789265474.978785:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265474.978798:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540329f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553767936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265474.978859:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265474.978931:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540329f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553767936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265474.978938:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789265474.979297:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265474.979373:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553767936:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789265475.070654:0:12300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:11:12 (1789265472) 00010000:00010000:1.0:1789265475.104663:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265475.203845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265475.203941:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533835904 00000100:00100000:2.0:1789265475.203955:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533835904 00000100:00100000:2.0:1789265475.204035:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 294 00000100:00100000:2.0:1789265475.204047:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2343:x1876180533835904:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265475.204155:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2343:x1876180533835904:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 110us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265475.204163:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 294 00000100:00100000:0.0:1789265475.212306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265475.212380:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533836032 00000100:00100000:0.0:1789265475.212404:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533836032 00000100:00100000:0.0:1789265475.212488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 144 00000100:00100000:0.0:1789265475.212513:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:2342:x1876180533836032:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265475.212635:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:2342:x1876180533836032:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 136us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265475.212644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 144 00000100:00080000:0.0:1789265475.212671:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265475.214715:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265475.214788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265475.224541:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265475.224591:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533836416 00000100:00100000:0.0:1789265475.224604:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533836416 00000100:00100000:0.0:1789265475.224687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 145 00000100:00100000:0.0:1789265475.224700:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2342:x1876180533836416:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265475.224815:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2342:x1876180533836416:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 118us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265475.224825:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 145 00000100:00080000:0.0:1789265475.224851:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265475.229560:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533836160 00000100:00100000:2.0:1789265475.229581:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533836160 00000100:00100000:2.0:1789265475.229678:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533836288 00000100:00100000:2.0:1789265475.229682:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533836288 00000100:00100000:2.0:1789265475.229726:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:2.0:1789265475.229740:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533836160:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265475.229845:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533836160:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 110us (15140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265475.229854:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:2.0:1789265475.229873:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:2.0:1789265475.229880:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533836288:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265475.229906:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533836288:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 27us (15118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265475.229912:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00080000:2.0:1789265475.231627:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265475.231640:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789265475.870785:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265475.870799:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265475.875219:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789265475.875248:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789265476.128046:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265476.940643:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265476.940837:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533836672 00000100:00100000:2.0:1789265476.940848:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533836672 00000100:00100000:2.0:1789265476.941200:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 137 00000100:00100000:2.0:1789265476.941214:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:11282:x1876180533836672:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265476.941239:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265476.941262:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fd7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85e0 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941391:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941406:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941421:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941437:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941445:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941453:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941789:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941799:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941807:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265476.941817:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789265476.941953:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941960:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941973:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941980:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265476.941984:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.941992:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942004:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92540cd7ac00) 00010000:00010000:2.0:1789265476.942007:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265476.942011:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942019:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fd82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942052:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942058:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942064:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942069:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265476.942071:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942089:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942098:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92540ccf3300) 00010000:00010000:2.0:1789265476.942100:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265476.942103:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942108:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fd89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942850:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fd7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85e0 expref: 16 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942870:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85e0 expref: 15 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265476.942879:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:2.0:1789265476.942881:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265476.942884:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136c00, rc 0) 00000100:00100000:2.0:1789265476.942963:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:11282:x1876180533836672:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1753us (2329us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789265476.942972:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 137 00000100:00100000:2.0:1789265476.958396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265476.958564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533836800 00000100:00100000:1.0:1789265476.958578:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533836800 00000100:00100000:1.0:1789265476.958650:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 138 00000100:00100000:1.0:1789265476.958661:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:11282:x1876180533836800:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789265476.958791:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:11282:x1876180533836800:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 Request processed in 131us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265476.958799:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 138 00000100:00100000:1.0:1789265476.959410:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265476.959474:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533836928 00000100:00100000:3.0:1789265476.959480:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533836928 00000100:00100000:3.0:1789265476.959533:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:3.0:1789265476.959542:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540517c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:2344:x1876180533836928:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265476.959554:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265476.959581:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fd90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85e0 expref: 15 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265476.959623:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:3.0:1789265476.959629:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265476.959681:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540517c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2344:x1876180533836928:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 140us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265476.959688:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00010000:00010000:0.0:1789265477.153918:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265477.538217:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553768448:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.538396:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265477.538403:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553768064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.538458:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553768576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.538510:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553768320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.538554:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789265477.538558:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553768192:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.538594:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553768704:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.538665:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553768448 00000100:00100000:1.0:1789265477.538674:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553768448 00000100:00100000:1.0:1789265477.538740:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553768704 00000100:00100000:1.0:1789265477.538744:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553768704 00000100:00100000:1.0:1789265477.538767:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789265477.538776:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553768448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538827:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553768448:12345-0@lo:400:kworker.0 Request processed in 53us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.538834:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789265477.538852:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265477.538859:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553768704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538891:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553768704:12345-0@lo:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.538897:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265477.538915:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553768064 00000100:00100000:1.0:1789265477.538919:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553768064 00000100:00100000:1.0:1789265477.538944:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789265477.538950:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553768064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.538977:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3304:x1876180553768064:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.538984:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789265477.539022:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553768576 00000100:00100000:1.0:1789265477.539026:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553768576 00000100:00100000:1.0:1789265477.539051:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553768320 00000100:00100000:1.0:1789265477.539055:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553768320 00000100:00100000:1.0:1789265477.539069:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553768192 00000100:00100000:1.0:1789265477.539072:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553768192 00000100:00100000:1.0:1789265477.539096:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265477.539102:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553768576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.539132:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553768576:12345-0@lo:400:kworker.0 Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.539138:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265477.539149:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265477.539154:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553768320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.539179:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876180553768320:12345-0@lo:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.539184:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265477.539194:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265477.539199:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553768192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.539223:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553768192:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.539229:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1789265477.539248:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265477.539252:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265477.539254:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265477.539440:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553768192:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.539453:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553768704:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.539465:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876180553768320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.539501:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3304:1876180553768064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.539511:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553768576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265477.539521:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553768448:0@lo:400:kworker.0 00000040:00080000:2.0:1789265477.921014:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265477.921025:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265477.921571:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1789265477.921589:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265478.047681:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265478.047705:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553768832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265478.047779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265478.047852:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553768832 00000100:00100000:3.0:1789265478.047861:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553768832 00000100:00100000:3.0:1789265478.047923:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265478.047932:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553768832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265478.047970:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265478.048040:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553768832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265478.048048:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265478.048103:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553768832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265478.175468:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265479.213397:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265479.489387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265479.489505:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533837056 00000100:00100000:1.0:1789265479.489515:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533837056 00000100:00100000:1.0:1789265479.489591:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 139 00000100:00100000:1.0:1789265479.489603:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:11324:x1876180533837056:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265479.489626:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265479.489647:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fd9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85e7 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.489714:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.489729:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.489742:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.489758:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.489766:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.489773:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490024:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490043:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490051:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490058:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265479.490063:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490071:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490083:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:1.0:1789265479.490087:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265479.490092:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490098:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818fda5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490113:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490119:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490125:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490131:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265479.490140:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490147:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490155:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92540cd7af00) 00010000:00010000:1.0:1789265479.490158:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265479.490161:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490168:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818fdac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490199:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fd9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85e7 expref: 15 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490209:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:1.0:1789265479.490212:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265479.490216:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef818fd9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85e7 expref: 15 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.490225:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5ec00, rc 0) 00000100:00100000:1.0:1789265479.490289:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:11324:x1876180533837056:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 689us (913us total) trans 0 rc 301/301 00000100:00100000:1.0:1789265479.490297:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 139 00000100:00080000:3.0:1789265479.490700:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265479.505931:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265479.506114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533837312 00000100:00100000:3.0:1789265479.506125:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533837312 00000100:00100000:3.0:1789265479.506220:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 140 00000100:00100000:3.0:1789265479.506231:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:11324:x1876180533837312:12345-192.168.204.43@tcp:36:lfs.0 00010000:00010000:3.0:1789265479.506305:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265479.506358:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818f71c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8420 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.506388:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:3.0:1789265479.506393:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265479.506639:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.506655:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.506666:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.506702:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.506717:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 5 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265479.506732:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b84bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876180553768960:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265479.506818:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254370436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265479.525323:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265479.525392:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533837440 00000100:00100000:1.0:1789265479.525401:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533837440 00010000:00010000:1.0:1789265479.525458:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 6 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265479.525740:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:1.0:1789265479.525752:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2343:x1876180533837440:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265479.525773:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265479.525780:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 6 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.525793:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 6 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.525816:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:1.0:1789265479.525823:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.525833:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.525841:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.525859:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265479.525911:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2343:x1876180533837440:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 160us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265479.525919:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00080000:1.0:1789265479.525947:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789265479.526165:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fd74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d9 expref: 5 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265479.526184:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b84bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876180553768960:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265479.526207:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.526215:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.526220:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.526243:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.526252:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.526260:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265479.529147:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789265479.529171:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.529183:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.529191:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.529221:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265479.529226:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.529233:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.529250:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:2.0:1789265479.529253:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265479.529258:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.529264:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef818fdb3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265479.529287:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd2a37dc reply state 0000000076fb27ca transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265479.529297:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265479.529900:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:11324:x1876180533837312:12345-192.168.204.43@tcp:36:lfs.0 Request processed in 23659us (23966us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789265479.529910:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 140 00010000:00010000:0.0:1789265479.539273:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.539293:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.539301:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.539327:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265479.539369:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.539377:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.539395:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92540ccf3300) 00010000:00010000:0.0:1789265479.539398:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265479.539403:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.539409:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818fdba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265479.705771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265479.706482:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533837568 00000100:00100000:0.0:1789265479.706495:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533837568 00000100:00100000:0.0:1789265479.706569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 141 00000100:00100000:0.0:1789265479.706579:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:11332:x1876180533837568:12345-192.168.204.43@tcp:101:lctl.0 00010000:00010000:0.0:1789265479.706605:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265479.706628:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818fdc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85ee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.706704:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818fdc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.706718:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818fdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.706750:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818fdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265479.706788:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789265479.706792:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265479.706815:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818fdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.706842:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818fdc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85ee expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.706867:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818fdc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85ee expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.706876:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:0.0:1789265479.706878:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265479.706881:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994000, rc 0) 00000100:00100000:0.0:1789265479.706953:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:11332:x1876180533837568:12345-192.168.204.43@tcp:101:lctl.0 Request processed in 375us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265479.706961:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 141 00000100:00100000:1.0:1789265479.799534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265479.799690:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533837696 00000100:00100000:0.0:1789265479.799702:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533837696 00000100:00100000:0.0:1789265479.799766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 142 00000100:00100000:0.0:1789265479.799776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+15:11338:x1876180533837696:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265479.799794:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265479.799816:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818fdcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85f5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.799901:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.799914:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.799929:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.799942:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.799949:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.799955:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800064:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fde4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800072:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800079:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265479.800107:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789265479.800111:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265479.800130:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800152:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800158:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800165:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800171:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265479.800176:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800183:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800195:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:0.0:1789265479.800198:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265479.800202:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800209:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fdd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800225:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800231:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800236:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800248:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265479.800251:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800258:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800266:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92542b074700) 00010000:00010000:0.0:1789265479.800269:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265479.800272:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800292:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fddd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800324:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818fdcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85f5 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800405:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fde4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85f5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.800563:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:0.0:1789265479.800567:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789265479.800570:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994400, rc 0) 00000100:00100000:0.0:1789265479.800640:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:11338:x1876180533837696:12345-192.168.204.43@tcp:101:bash.0 Request processed in 864us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265479.800648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 142 00000100:00100000:3.0:1789265479.805019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265479.805303:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533837952 00000100:00100000:2.0:1789265479.805313:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533837952 00000100:00100000:2.0:1789265479.805431:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 143 00000100:00100000:2.0:1789265479.805442:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+16:11338:x1876180533837952:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265479.805464:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265479.805487:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fdeb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f85fc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.805633:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.805649:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.805661:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.806143:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.806155:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.806162:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265479.807374:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789265479.807578:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807593:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807603:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807639:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807657:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807662:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807668:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265479.807672:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807679:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807706:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265479.807709:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265479.807713:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807719:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fdf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265479.807732:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014556613 reply state 000000009104acb8 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265479.807740:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265479.807775:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818fdeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807786:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.807803:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:2.0:1789265479.807805:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265479.807807:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136c00, rc 0) 00000100:00100000:2.0:1789265479.807885:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11338:x1876180533837952:12345-192.168.204.43@tcp:101:bash.0 Request processed in 2446us (2878us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789265479.807894:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 143 00010000:00010000:3.0:1789265479.814028:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.814049:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.814056:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.814085:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265479.814091:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.814099:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.814118:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3b00) 00010000:00010000:3.0:1789265479.814121:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265479.814127:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.814133:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fdf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265479.816219:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265479.818121:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533838080 00000100:00100000:1.0:1789265479.818136:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533838080 00000100:00100000:1.0:1789265479.818250:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:1.0:1789265479.818262:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2344:x1876180533838080:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1789265479.818293:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265479.818316:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8603 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265479.818372:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265479.818395:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1789265479.818400:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265479.818410:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.818448:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.818464:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f000, rc 0) 00000100:00100000:1.0:1789265479.818532:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2344:x1876180533838080:12345-192.168.204.43@tcp:101:bash.0 Request processed in 272us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265479.818540:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00080000:3.0:1789265479.819387:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265479.824944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265479.825055:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533838208 00000100:00100000:1.0:1789265479.825066:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533838208 00000100:00100000:1.0:1789265479.825128:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:1.0:1789265479.825138:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:11338:x1876180533838208:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1789265479.825156:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265479.825176:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f860a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.825227:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.825236:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265479.825240:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265479.825245:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.825278:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.825291:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 7 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265479.825304:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1876180553769088:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265479.825447:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a847b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265479.828722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265479.829171:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533838336 00000100:00100000:3.0:1789265479.829181:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533838336 00010000:00010000:3.0:1789265479.829224:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 8 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265479.829270:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:3.0:1789265479.829281:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533838336:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265479.829297:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265479.829322:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 8 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.829399:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 8 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.829437:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265479.829442:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265479.829451:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.829462:0:11653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.829503:0:11653:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265479.829517:0:11653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b848380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11653:1876180553769216:192.168.204.43@tcp:105: 00000100:00100000:3.0:1789265479.829604:0:11653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254370433c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789265479.831372:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001302bf6b/0x8e12577ef818fe0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8603 expref: 8 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265479.831397:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1876180553769088:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265479.831439:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.831453:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f600, rc 0) 00000100:00100000:2.0:1789265479.831566:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:11338:x1876180533838208:12345-192.168.204.43@tcp:101:bash.0 Request processed in 6429us (6633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265479.831575:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:3.0:1789265479.834636:0:11653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b848380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11653:1876180553769216:192.168.204.43@tcp:105: 00010000:00010000:3.0:1789265479.834666:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265479.834740:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533838336:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 5459us (6025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265479.834750:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:3.0:1789265479.839043:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265479.839245:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533838592 00000100:00100000:1.0:1789265479.839255:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533838592 00000100:00100000:1.0:1789265479.839318:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:1.0:1789265479.839327:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:11338:x1876180533838592:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:1.0:1789265479.839956:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11338:x1876180533838592:12345-192.168.204.43@tcp:35:bash.0 Request processed in 628us (919us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789265479.839976:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:1.0:1789265479.941446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265479.941597:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533838848 00000100:00100000:2.0:1789265479.941607:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533838848 00000100:00100000:2.0:1789265479.941659:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 144 00000100:00100000:2.0:1789265479.941668:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11349:x1876180533838848:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265479.941689:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265479.941710:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fe1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8611 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265479.941822:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789265479.941958:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fe1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8611 expref: 21 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.941987:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:2.0:1789265479.941990:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265479.941995:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef818fe1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8611 expref: 21 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265479.942011:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137e00, rc 0) 00000100:00100000:2.0:1789265479.942076:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:11349:x1876180533838848:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 408us (639us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789265479.942083:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 144 00000100:00100000:2.0:1789265479.945049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265479.945152:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533839104 00000100:00100000:1.0:1789265479.945162:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533839104 00000100:00100000:1.0:1789265479.945227:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:1.0:1789265479.945237:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:11349:x1876180533839104:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1789265479.945513:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:11349:x1876180533839104:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 277us (472us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789265479.945521:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:2.0:1789265480.094999:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265480.095026:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553769344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265480.095103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265480.095934:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553769344 00000100:00100000:3.0:1789265480.095946:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553769344 00000100:00100000:3.0:1789265480.096104:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265480.096116:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553769344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265480.096154:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265480.096214:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553769344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265480.096222:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265480.096359:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265480.096393:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533839232 00000100:00100000:0.0:1789265480.096397:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533839232 00000100:00100000:0.0:1789265480.096442:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 145 00000100:00100000:0.0:1789265480.096450:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:11355:x1876180533839232:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265480.096467:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265480.096489:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818fe2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8618 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.096556:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fe31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.096573:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fe31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.096585:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fe31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265480.096619:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789265480.096623:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265480.096639:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fe31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.096666:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818fe2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8618 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.096699:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fe31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8618 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.096708:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:0.0:1789265480.096712:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265480.096722:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995200, rc 0) 00000100:00100000:0.0:1789265480.096772:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:11355:x1876180533839232:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 323us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265480.096779:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 145 00000100:00080000:1.0:1789265480.097049:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265480.097279:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553769344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265480.105873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265480.106004:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533839488 00000100:00100000:3.0:1789265480.106016:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533839488 00000100:00100000:3.0:1789265480.106116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 146 00000100:00100000:3.0:1789265480.106128:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:11355:x1876180533839488:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265480.106149:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265480.106173:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818fe38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f861f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.106287:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818fe3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.106303:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818fe3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.106315:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818fe3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265480.106327:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789265480.106563:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818fe38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f861f expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.106583:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818fe3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f861f expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.106611:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:3.0:1789265480.106614:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265480.106618:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885c00, rc 0) 00000100:00100000:3.0:1789265480.106677:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:11355:x1876180533839488:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 551us (815us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789265480.106684:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 146 00000100:00100000:1.0:1789265480.112385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265480.112542:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533839616 00000100:00100000:3.0:1789265480.112553:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533839616 00000100:00100000:3.0:1789265480.112624:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:3.0:1789265480.112636:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:2344:x1876180533839616:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265480.112653:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265480.112680:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818fe3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f861f expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.112700:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:3.0:1789265480.112705:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265480.112765:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:2344:x1876180533839616:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 132us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265480.112772:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1789265480.118621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265480.120513:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533839872 00000100:00100000:2.0:1789265480.120529:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533839872 00000100:00100000:2.0:1789265480.120600:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 147 00000100:00100000:2.0:1789265480.120611:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:11355:x1876180533839872:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265480.120637:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265480.120660:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fe4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8626 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.120791:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fe54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.120806:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fe54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.120817:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fe54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265480.120829:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789265480.121038:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818fe4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8626 expref: 26 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.121057:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fe54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8626 expref: 25 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.121065:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:2.0:1789265480.121068:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265480.121071:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137a00, rc 0) 00000100:00100000:2.0:1789265480.121207:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:11355:x1876180533839872:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 598us (2595us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789265480.121214:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 147 00000100:00100000:2.0:1789265480.138275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265480.138520:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533840000 00000100:00100000:1.0:1789265480.138532:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533840000 00000100:00100000:1.0:1789265480.138589:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:1.0:1789265480.138600:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533840000:12345-192.168.204.43@tcp:1:lfs.0 00010000:00010000:1.0:1789265480.138650:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.138675:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.138684:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265480.138688:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265480.138693:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.138733:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.138763:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 6 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265480.138779:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1876180553769472:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265480.138882:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a847a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265480.147184:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265480.147477:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1876180553769472:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265480.147507:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265480.147716:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533840128 00000100:00100000:3.0:1789265480.147724:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533840128 00002000:00100000:3.0:1789265480.147775:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff92543775d180 x1876180533840128/t0(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:51/0 lens 504/0 e 0 to 0 dl 1789265491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265480.147785:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543775d180 with x1876180533840128 ext(0->12) 00010000:00010000:3.0:1789265480.147793:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 7 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.147813:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 7 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265480.147822:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92543775d180 00000100:00100000:3.0:1789265480.148078:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:3.0:1789265480.148089:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533840128:12345-192.168.204.43@tcp:4:lfs.0 00000100:00100000:3.0:1789265480.149070:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2343:x1876180533840128:12345-192.168.204.43@tcp:4:lfs.0 Request processed in 977us (1892us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789265480.149081:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00002000:00100000:3.0:1789265480.149090:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff92543775d180 x1876180533840128/t4294967305(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:51/0 lens 504/448 e 0 to 0 dl 1789265491 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265480.149100:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543775d180 with x1876180533840128 ext(0->12) 00010000:00010000:3.0:1789265480.149108:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 9 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.149124:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 9 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265480.149132:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92543775d180 00000100:00100000:0.0:1789265480.154187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265480.154461:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533840256 00000100:00100000:2.0:1789265480.154472:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533840256 00010000:00010000:2.0:1789265480.154514:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 9 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265480.154562:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:2.0:1789265480.154572:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2342:x1876180533840256:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265480.154589:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789265480.154610:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789265480.154613:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789265478 00002000:00010000:2.0:1789265480.154615:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789265479 00002000:00010000:2.0:1789265480.154617:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789265478 00010000:00010000:2.0:1789265480.154623:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 9 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.154638:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 9 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.154663:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068fde627/0x8e12577ef818fe15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f860a expref: 9 pid: 6680 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.154682:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265480.154687:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265480.154693:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.154722:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.154821:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265480.154884:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533840256:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 313us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265480.154892:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00010000:00010000:1.0:1789265480.157212:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.157232:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.157276:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.157284:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.157292:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.157299:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ec00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265480.157303:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.157530:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.157551:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.157559:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008295a8d1/0x8e12577ef818fe62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265480.157719:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533840000:12345-192.168.204.43@tcp:1:lfs.0 Request processed in 19116us (19451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265480.157729:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:0.0:1789265480.167155:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265480.167248:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533840512 00000100:00100000:1.0:1789265480.167258:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533840512 00000100:00100000:1.0:1789265480.167374:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:1.0:1789265480.167385:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:11355:x1876180533840512:12345-192.168.204.43@tcp:35:lfs.0 00000004:00010000:1.0:1789265480.167459:0:12056:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fe54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8626 expref: 25 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265480.167779:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1789265480.167826:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789265480.168370:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789265480.168433:0:12056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.168451:0:12056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.168466:0:12056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.168505:0:12056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265480.168520:0:12056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 29 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265480.168536:0:12056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12056:1876180553769600:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265480.168810:0:12056:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a847000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265480.172404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265480.172737:0:12056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12056:1876180553769600:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265480.172769:0:12056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265480.172944:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533840640 00000100:00100000:3.0:1789265480.172952:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533840640 00010000:00010000:3.0:1789265480.173006:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 30 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265480.173072:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:3.0:1789265480.173082:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:2342:x1876180533840640:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265480.173098:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265480.173106:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 30 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.173118:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 30 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.173145:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818fe00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85fc expref: 30 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.173163:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:3.0:1789265480.173169:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.173182:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.173189:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.173233:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265480.173382:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:2342:x1876180533840640:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 300us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265480.173390:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00010000:00010000:2.0:1789265480.173644:0:12056:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.173653:0:12056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265480.173794:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789265480.174038:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789265480.174156:0:12056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12056:1876180553769728:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789265480.174218:0:12056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265480.174262:0:12056:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265480.174387:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553769728 00000100:00100000:1.0:1789265480.174395:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553769728 00000100:00100000:1.0:1789265480.174461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265480.174470:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12056:x1876180553769728:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789265480.174548:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12056:x1876180553769728:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 78us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265480.174555:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265480.174919:0:12056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12056:1876180553769728:0@lo:1000:mdt_rdpg00_002.0 00000100:00080000:3.0:1789265480.175593:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789265480.175866:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789265480.176204:0:12056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12056:1876180553769856:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789265480.176261:0:12056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265480.176297:0:12056:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265480.176394:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553769856 00000100:00100000:1.0:1789265480.176401:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553769856 00000100:00100000:1.0:1789265480.176443:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265480.176453:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12056:x1876180553769856:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789265480.176669:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12056:x1876180553769856:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 217us (406us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789265480.176677:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265480.176737:0:12056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12056:1876180553769856:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1789265480.176976:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789265480.177084:0:12056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.177097:0:12056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.177105:0:12056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.177112:0:12056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ee00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265480.177117:0:12056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.177126:0:12056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.177143:0:12056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:3.0:1789265480.177146:0:12056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789265480.177151:0:12056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265480.177158:0:12056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef818fe69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265480.177568:0:12056:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789265480.177784:0:12056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789265480.177798:0:12056:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335411465247ns, next at 336411463220ns, rc = 0 00000001:00080000:3.0:1789265480.177805:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789265480.177923:0:12056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3d00) 00010000:00010000:3.0:1789265480.177938:0:12056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265480.177947:0:12056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818fe54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8626 expref: 33 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265480.178138:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11355:x1876180533840512:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 10754us (10991us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789265480.178148:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000020:00080000:3.0:1789265480.178153:0:12056:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789265480.189327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265480.189605:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533840768 00000100:00100000:0.0:1789265480.189617:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533840768 00000100:00100000:0.0:1789265480.189713:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 148 00000100:00100000:0.0:1789265480.189725:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11355:x1876180533840768:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265480.189758:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265480.189789:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fe70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f862d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.189871:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fe70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f862d expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.189888:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fe70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f862d expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.189909:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265480.189912:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265480.189916:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994c00, rc 0) 00000100:00100000:0.0:1789265480.190365:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:11355:x1876180533840768:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 610us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265480.190394:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 148 00000100:00100000:1.0:1789265480.196501:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265480.196668:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533841024 00000100:00100000:0.0:1789265480.196679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533841024 00000100:00100000:0.0:1789265480.196740:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1789265480.196751:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:11355:x1876180533841024:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265480.197272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11355:x1876180533841024:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 521us (779us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789265480.197281:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00010000:00010000:2.0:1789265480.224084:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265480.319725:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265480.319770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265480.319805:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265480.320086:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533841408 00000100:00100000:0.0:1789265480.320095:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533841408 00000100:00100000:0.0:1789265480.320160:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 149 00000100:00100000:0.0:1789265480.320171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533841408:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265480.320263:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2342:x1876180533841408:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 93us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265480.320272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 149 00000100:00100000:1.0:1789265480.321387:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533841280 00000100:00100000:1.0:1789265480.321399:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533841280 00000100:00100000:1.0:1789265480.321495:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:1.0:1789265480.321503:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533841280:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265480.321567:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533841280:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 65us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265480.321575:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:2.0:1789265480.322196:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533841152 00000100:00100000:2.0:1789265480.322203:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533841152 00000100:00100000:2.0:1789265480.322247:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 296 00000100:00100000:2.0:1789265480.322255:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2342:x1876180533841152:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265480.322293:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2342:x1876180533841152:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 40us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265480.322301:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 296 00000100:00080000:3.0:1789265480.323147:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265480.341994:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265480.342180:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533841664 00000100:00100000:0.0:1789265480.342191:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533841664 00000100:00100000:0.0:1789265480.342260:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 149 00000100:00100000:0.0:1789265480.342272:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11365:x1876180533841664:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265480.342295:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265480.342315:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fe77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8634 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265480.342523:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789265480.342850:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fe77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8634 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.342882:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:0.0:1789265480.342885:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265480.342891:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef818fe77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8634 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.342908:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994a00, rc 0) 00000100:00100000:0.0:1789265480.343110:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11365:x1876180533841664:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 839us (1126us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1789265480.343118:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 149 00000100:00100000:0.0:1789265480.355794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265480.356367:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533841792 00000100:00100000:2.0:1789265480.356382:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533841792 00000100:00100000:2.0:1789265480.356465:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 150 00000100:00100000:2.0:1789265480.356476:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11365:x1876180533841792:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:2.0:1789265480.356568:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.356595:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.356608:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.356624:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.356630:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.356636:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.356747:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.357516:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.357525:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265480.357583:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358076:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358084:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358092:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358099:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265480.358103:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358111:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358125:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265480.358128:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265480.358132:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358138:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fe85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358167:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358174:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358179:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358184:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265480.358187:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358192:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358200:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3800) 00010000:00010000:2.0:1789265480.358202:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265480.358205:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358210:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fe8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358226:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358231:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358236:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358246:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265480.358249:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358256:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358265:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265480.358267:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265480.358270:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.358276:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265480.358445:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11365:x1876180533841792:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1966us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265480.358455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 150 00000100:00100000:1.0:1789265480.365441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265480.365801:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533842048 00000100:00100000:3.0:1789265480.365812:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533842048 00000100:00100000:3.0:1789265480.365863:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:3.0:1789265480.365874:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11365:x1876180533842048:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265480.366261:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11365:x1876180533842048:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 387us (830us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789265480.366269:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:3.0:1789265480.432813:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265480.436243:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533842304 00000100:00100000:2.0:1789265480.436259:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533842304 00000100:00100000:2.0:1789265480.436354:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 151 00000100:00100000:2.0:1789265480.436365:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11368:x1876180533842304:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265480.436390:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265480.436573:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f863b expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.436644:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.436686:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.436698:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.436715:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.436722:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.436728:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.436905:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.436914:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437041:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265480.437055:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789265480.437152:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437161:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437168:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437180:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265480.437184:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437192:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437205:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265480.437208:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265480.437213:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437220:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef818fea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437235:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437241:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437247:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437252:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265480.437255:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437261:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437279:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3800) 00010000:00010000:2.0:1789265480.437282:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265480.437285:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437291:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437484:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fe9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 39 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437501:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 38 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.437508:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265480.437510:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265480.437513:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137a00, rc 0) 00000100:00100000:2.0:1789265480.437584:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11368:x1876180533842304:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1220us (4782us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789265480.437592:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 151 00000100:00100000:3.0:1789265480.444213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265480.444311:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533842432 00000100:00100000:2.0:1789265480.444322:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533842432 00000100:00100000:2.0:1789265480.444420:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 152 00000100:00100000:2.0:1789265480.444430:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11368:x1876180533842432:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:2.0:1789265480.444508:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444526:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444554:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444581:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444587:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444593:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444598:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265480.444603:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444609:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444621:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265480.444624:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265480.444628:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.444633:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef818febd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265480.444718:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11368:x1876180533842432:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 289us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265480.444726:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 152 00000100:00100000:3.0:1789265480.450750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265480.450885:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533842688 00000100:00100000:2.0:1789265480.450909:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533842688 00000100:00100000:2.0:1789265480.450969:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:2.0:1789265480.450980:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11368:x1876180533842688:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:2.0:1789265480.451225:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+39:11368:x1876180533842688:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 247us (484us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789265480.451233:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00000001:00080000:0.0:1789265480.670378:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967433 is committed 00000001:00080000:0.0:1789265480.670432:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000020:00080000:0.0:1789265480.670445:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff925409d9d840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789265480.670451:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925435e3ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff925409d9dd80 00000020:00080000:0.0:1789265480.670454:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925435e3ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff925402cb2800 00000004:00080000:0.0:1789265480.670496:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1789265480.670631:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bbde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553769984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789265480.670698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789265480.670867:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789265480.671063:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789265480.671236:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553769984 00000100:00100000:2.0:1789265480.671244:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553769984 00000100:00100000:2.0:1789265480.671302:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789265480.671312:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876180553769984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789265480.671378:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789265480.671427:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa60646, atime: 0x6aa60647, ctime: 0x6aa60646, blocks: 0x1 00010000:00010000:2.0:1789265480.671436:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.671452:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1789265480.671457:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265480.671463:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.671476:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.671485:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.671492:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.671524:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265480.672540:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265480.672549:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.672560:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136c00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265480.672563:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.672581:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.672600:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.672606:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcf4d147/0x8e12577ef818fec4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.672631:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265480.672634:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265480.672636:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265480.673115:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553769984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1800us (2411us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789265480.673127:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1789265480.673266:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92543bbde300/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789265480.673273:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bbde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553769984:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265480.953784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265480.954141:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533842944 00000100:00100000:0.0:1789265480.954151:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533842944 00000100:00100000:0.0:1789265480.954228:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 153 00000100:00100000:0.0:1789265480.954249:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:11399:x1876180533842944:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:0.0:1789265480.954275:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265480.954302:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8642 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.954448:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818fed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.954463:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818fed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.954495:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818fed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265480.954509:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789265480.954761:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8642 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.954782:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818fed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8642 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265480.954792:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265480.954795:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265480.954799:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995400, rc 0) 00000100:00100000:0.0:1789265480.954871:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11399:x1876180533842944:12345-192.168.204.43@tcp:101:cat.0 Request processed in 634us (1100us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789265480.954879:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 153 00000100:00100000:0.0:1789265480.966855:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265480.966989:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533843328 00000100:00100000:2.0:1789265480.967000:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533843328 00000100:00100000:2.0:1789265480.967084:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1789265480.967095:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:2343:x1876180533843328:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265480.967112:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265480.967140:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef818fed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8642 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265480.967163:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265480.967168:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265480.967232:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:2343:x1876180533843328:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 139us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265480.967249:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:3.0:1789265480.972373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265480.973601:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533843200 00000100:00100000:0.0:1789265480.973614:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533843200 00000100:00100000:0.0:1789265480.973694:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:0.0:1789265480.973707:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:11399:x1876180533843200:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:0.0:1789265480.974101:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11399:x1876180533843200:12345-192.168.204.43@tcp:35:cat.0 Request processed in 394us (1778us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789265480.974110:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:3.0:1789265481.051815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265481.053785:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533843584 00000100:00100000:2.0:1789265481.053801:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533843584 00000100:00100000:2.0:1789265481.053975:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 154 00000100:00100000:2.0:1789265481.053991:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11405:x1876180533843584:12345-192.168.204.43@tcp:101:dd.0 00010000:00010000:2.0:1789265481.054023:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265481.054027:0:9189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789265481.054060:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef818fe31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8618 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.054106:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265481.054111:0:9189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265481.054126:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fee0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8649 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.054236:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.054251:0:9189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 19 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.054260:0:9189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.054296:0:9189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 19 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.054310:0:9189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 19 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265481.054325:0:9189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553770112:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265481.054490:0:9189:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403280cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1789265481.058847:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265481.062065:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265481.063171:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533843712 00000100:00100000:3.0:1789265481.063203:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533843712 00010000:00010000:3.0:1789265481.063257:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 20 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265481.063320:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:3.0:1789265481.063350:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540517d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:2342:x1876180533843712:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265481.063366:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265481.063373:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 20 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265481.063396:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 20 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265481.063422:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:3.0:1789265481.063429:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265481.063439:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265481.063448:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265481.063587:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265481.063727:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540517d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:2342:x1876180533843712:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 397us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.063736:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00010000:00010000:2.0:1789265481.069216:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818feaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f863b expref: 19 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265481.069248:0:9189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553770112:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265481.069305:0:9189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.069316:0:9189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.069322:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265481.069371:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789265481.069572:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fee0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 20 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.069588:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 19 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.069598:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265481.069601:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265481.069605:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137400, rc 0) 00000100:00100000:2.0:1789265481.070039:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11405:x1876180533843584:12345-192.168.204.43@tcp:101:dd.0 Request processed in 16052us (18232us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789265481.070053:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 154 00000100:00100000:1.0:1789265481.087618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265481.090500:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533843968 00000100:00100000:0.0:1789265481.090519:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533843968 00000100:00100000:0.0:1789265481.090698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 155 00000100:00100000:0.0:1789265481.090711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11405:x1876180533843968:12345-192.168.204.43@tcp:36:dd.0 00010000:00010000:0.0:1789265481.091036:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265481.091054:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265481.091066:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265481.091121:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1789265481.091147:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001da0f1c7 reply state 000000005a50a3c8 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265481.091158:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265481.091275:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:11405:x1876180533843968:12345-192.168.204.43@tcp:36:dd.0 Request processed in 567us (3669us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789265481.091284:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 155 00000020:00080000:0.0:1789265481.091290:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265481.095594:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.095613:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.095622:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.095651:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265481.095657:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.095665:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.095685:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265481.095688:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265481.095692:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.095697:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef818fef5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265481.246549:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265481.464547:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265481.464619:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533844096 00000100:00100000:2.0:1789265481.464631:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533844096 00000100:00100000:2.0:1789265481.464822:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 156 00000100:00100000:2.0:1789265481.464837:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:11419:x1876180533844096:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:2.0:1789265481.464863:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265481.464884:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fefc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8650 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.464981:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.464997:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465009:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465042:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465051:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465058:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465386:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465397:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 22 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465404:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465434:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 22 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.465447:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 22 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265481.465461:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553770240:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265481.465619:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403280300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265481.481080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265481.481526:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533844352 00000100:00100000:3.0:1789265481.481567:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533844352 00000100:00100000:3.0:1789265481.481628:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:3.0:1789265481.481638:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:5585:x1876180533844352:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789265481.481970:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:5585:x1876180533844352:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 333us (899us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789265481.482908:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1789265481.483226:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553770240:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265481.483265:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265481.488047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265481.488319:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533844480 00000100:00100000:2.0:1789265481.488353:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533844480 00010000:00010000:2.0:1789265481.488426:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 24 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265481.488472:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:2.0:1789265481.488483:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:2342:x1876180533844480:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265481.488503:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265481.488510:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 24 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.488524:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 24 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.488563:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818fee7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8649 expref: 24 pid: 9189 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.488582:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265481.488588:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.488598:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.488607:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.488648:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265481.488709:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:2342:x1876180533844480:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 228us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265481.488717:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00010000:00010000:1.0:1789265481.489788:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.489802:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265481.489867:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789265481.489871:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265481.489892:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.489923:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.489932:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.489949:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.489956:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.489962:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265481.489966:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.489973:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.489999:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:1.0:1789265481.490002:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265481.490006:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490011:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef818ff03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490025:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490032:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490044:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490048:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265481.490051:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490057:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490064:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3c00) 00010000:00010000:1.0:1789265481.490066:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265481.490068:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490074:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef818ff0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490119:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818fefc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8650 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490133:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8650 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265481.490139:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:1.0:1789265481.490141:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265481.490144:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136200, rc 0) 00000100:00100000:1.0:1789265481.490680:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:11419:x1876180533844096:12345-192.168.204.43@tcp:101:stat.0 Request processed in 25846us (26142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265481.490698:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 156 00000100:00100000:0.0:1789265481.617183:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265481.617305:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533844736 00000100:00100000:2.0:1789265481.617316:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533844736 00000100:00100000:2.0:1789265481.617408:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 157 00000100:00100000:2.0:1789265481.617418:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:11425:x1876180533844736:12345-192.168.204.43@tcp:36:truncate.0 00010000:00010000:2.0:1789265481.617482:0:9189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265481.617510:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8650 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.617541:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265481.617547:0:9189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265481.617758:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.617772:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.617783:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265481.617831:0:9189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789265481.617853:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df8f851f reply state 00000000d90b3d67 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265481.617862:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265481.617962:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:11425:x1876180533844736:12345-192.168.204.43@tcp:36:truncate.0 Request processed in 545us (791us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789265481.617970:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 157 00000020:00080000:2.0:1789265481.617975:0:9189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265481.624427:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265481.624450:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265481.624480:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265481.624490:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265481.624496:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265481.624508:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265481.624530:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265481.624537:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265481.624545:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265481.624553:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265481.885403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265481.886123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533844864 00000100:00100000:2.0:1789265481.886136:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533844864 00000100:00100000:2.0:1789265481.886484:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 158 00000100:00100000:2.0:1789265481.886495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:11439:x1876180533844864:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:2.0:1789265481.886522:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265481.886546:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8657 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.886619:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.886634:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.886663:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.886680:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.886687:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.886694:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887219:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887231:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887238:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265481.887288:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789265481.887293:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265481.887317:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887328:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887370:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887376:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887383:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887389:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265481.887394:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887401:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887414:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265481.887417:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265481.887422:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887429:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ff26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887453:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887459:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887464:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887469:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265481.887472:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887477:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887484:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3a00) 00010000:00010000:2.0:1789265481.887486:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265481.887488:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887493:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887530:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887544:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265481.887562:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265481.887564:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265481.887567:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137800, rc 0) 00000100:00100000:2.0:1789265481.888204:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:11439:x1876180533844864:12345-192.168.204.43@tcp:101:stat.0 Request processed in 1707us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265481.888214:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 158 00000100:00100000:2.0:1789265482.021664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265482.022076:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533845120 00000100:00100000:1.0:1789265482.022088:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533845120 00000100:00100000:1.0:1789265482.022401:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 159 00000100:00100000:1.0:1789265482.022425:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:11449:x1876180533845120:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265482.022450:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265482.022474:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818ff3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f865e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265482.022578:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789265482.022740:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818ff3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f865e expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.022754:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:1.0:1789265482.022758:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265482.022763:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef818ff3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f865e expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.022779:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f200, rc 0) 00000100:00100000:1.0:1789265482.022848:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:11449:x1876180533845120:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 438us (1212us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789265482.022856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 159 00000100:00100000:0.0:1789265482.032573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265482.032800:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533845376 00000100:00100000:3.0:1789265482.032811:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533845376 00000100:00100000:3.0:1789265482.032874:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:3.0:1789265482.032885:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:11449:x1876180533845376:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265482.034447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11449:x1876180533845376:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 1552us (1871us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789265482.034461:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:0.0:1789265482.170399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265482.170641:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533845632 00000100:00100000:2.0:1789265482.170652:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533845632 00000100:00100000:2.0:1789265482.170723:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 160 00000100:00100000:2.0:1789265482.170732:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11455:x1876180533845632:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265482.170756:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265482.170779:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8665 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.170950:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.170978:0:9189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.170986:0:9189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.171021:0:9189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.171049:0:9189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 27 pid: 5835 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265482.171064:0:9189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553770368:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265482.171164:0:9189:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403280cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265482.182442:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265482.182527:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533845760 00000100:00100000:3.0:1789265482.182538:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533845760 00010000:00010000:3.0:1789265482.182583:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 28 pid: 5835 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265482.182628:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:3.0:1789265482.182638:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:2343:x1876180533845760:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265482.182655:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265482.182662:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 28 pid: 5835 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.182676:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 28 pid: 5835 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.182720:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:3.0:1789265482.182726:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.182735:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.182743:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.182764:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265482.182827:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:2343:x1876180533845760:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 189us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265482.182833:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 65 00010000:00010000:2.0:1789265482.185601:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef818ff34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8657 expref: 27 pid: 5835 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265482.185632:0:9189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553770368:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265482.185661:0:9189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.185672:0:9189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.185679:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265482.185703:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789265482.185915:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 28 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.185944:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 27 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.185955:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265482.185986:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265482.185990:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137400, rc 0) 00000100:00100000:2.0:1789265482.186073:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:11455:x1876180533845632:12345-192.168.204.43@tcp:101:bash.0 Request processed in 15340us (15683us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789265482.186083:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 160 00000100:00100000:1.0:1789265482.193235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265482.193388:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533846016 00000100:00100000:2.0:1789265482.193401:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533846016 00000100:00100000:2.0:1789265482.193472:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 161 00000100:00100000:2.0:1789265482.193484:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:11455:x1876180533846016:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:2.0:1789265482.193778:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.193797:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.193810:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265482.193878:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1789265482.193905:0:9387:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce545afb reply state 000000008d79f9f4 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265482.193916:0:9387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265482.194014:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:11455:x1876180533846016:12345-192.168.204.43@tcp:36:bash.0 Request processed in 531us (790us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789265482.194022:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 161 00000020:00080000:2.0:1789265482.194027:0:9387:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265482.196320:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.196359:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.196394:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.196401:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265482.196406:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.196414:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.196429:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265482.196432:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265482.196437:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.196445:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265482.206075:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265482.206384:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533846144 00000100:00100000:0.0:1789265482.206395:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533846144 00000100:00100000:0.0:1789265482.206464:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 162 00000100:00100000:0.0:1789265482.206475:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:11455:x1876180533846144:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265482.206500:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265482.206524:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818ff65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f866c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.206638:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.206653:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 30 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.206663:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.206701:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 30 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.206716:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 30 pid: 9189 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265482.206732:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bbdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553770496:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265482.206835:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254012546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265482.210305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265482.210454:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533846272 00000100:00100000:2.0:1789265482.210468:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533846272 00010000:00010000:2.0:1789265482.210521:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 31 pid: 9189 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265482.210574:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:2.0:1789265482.210585:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:2343:x1876180533846272:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265482.210603:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265482.210611:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 31 pid: 9189 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.210649:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 31 pid: 9189 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.210676:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265482.210683:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.210694:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.210702:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.210724:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265482.210790:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:2343:x1876180533846272:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 206us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265482.210799:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00010000:00010000:0.0:1789265482.212531:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef818ff50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8665 expref: 30 pid: 9189 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265482.212560:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bbdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553770496:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265482.212588:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.212598:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.212628:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265482.212684:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789265482.212689:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265482.212710:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.212747:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994200/0x8e12577ef818ff65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f866c expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.212764:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f866c expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.212773:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265482.212777:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265482.212780:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994e00, rc 0) 00000100:00100000:0.0:1789265482.213237:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:11455:x1876180533846144:12345-192.168.204.43@tcp:101:bash.0 Request processed in 6761us (7172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.213247:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 162 00000100:00100000:3.0:1789265482.224877:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265482.225145:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533846528 00000100:00100000:2.0:1789265482.225157:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533846528 00000100:00100000:2.0:1789265482.225228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:2.0:1789265482.225240:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:11455:x1876180533846528:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:2.0:1789265482.225930:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:11455:x1876180533846528:12345-192.168.204.43@tcp:35:bash.0 Request processed in 609us (982us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789265482.225941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00010000:00010000:1.0:1789265482.271364:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265482.332830:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265482.337459:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533846784 00000100:00100000:2.0:1789265482.337476:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533846784 00000100:00100000:2.0:1789265482.337646:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 163 00000100:00100000:2.0:1789265482.337679:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+30:11465:x1876180533846784:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265482.337706:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265482.337730:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8673 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265482.337830:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789265482.338154:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8673 expref: 32 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.338169:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:2.0:1789265482.338172:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265482.338177:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ff73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8673 expref: 32 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.338194:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136200, rc 0) 00000100:00100000:2.0:1789265482.338271:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:11465:x1876180533846784:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 594us (5452us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789265482.338279:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 163 00000100:00100000:1.0:1789265482.352500:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265482.352599:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533846912 00000100:00100000:3.0:1789265482.352614:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533846912 00000100:00100000:3.0:1789265482.352690:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 164 00000100:00100000:3.0:1789265482.352701:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:11465:x1876180533846912:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:3.0:1789265482.352801:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.352825:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.352839:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353059:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353068:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353075:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353598:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353610:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353618:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265482.353667:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353681:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353687:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353694:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353700:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265482.353704:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353718:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353733:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:3.0:1789265482.353736:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265482.353741:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353748:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef818ff81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353763:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353768:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353773:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353777:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265482.353780:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353785:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353791:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff925409ab9000) 00010000:00010000:3.0:1789265482.353794:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265482.353796:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353811:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ff88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353827:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353832:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353837:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.353842:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265482.354426:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.354436:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.354447:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:3.0:1789265482.354450:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265482.354454:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.354459:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ff8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265482.354577:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:11465:x1876180533846912:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1871us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265482.354588:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 164 00000100:00100000:3.0:1789265482.361258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265482.369624:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533847168 00000100:00100000:1.0:1789265482.369641:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533847168 00000100:00100000:0.0:1789265482.370028:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:0.0:1789265482.370042:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:11465:x1876180533847168:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265482.370323:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11465:x1876180533847168:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 283us (9076us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789265482.370352:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:0.0:1789265482.432046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265482.432204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533847424 00000100:00100000:1.0:1789265482.432218:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533847424 00000100:00100000:1.0:1789265482.432299:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 165 00000100:00100000:1.0:1789265482.432310:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11468:x1876180533847424:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265482.432384:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265482.432417:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818ff96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f867a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432518:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432534:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432546:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432562:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432569:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432576:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432932:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818ffab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432951:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818ffab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.432959:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818ffab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265482.432970:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789265482.433081:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433088:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433094:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433099:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265482.433103:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433109:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433122:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:1.0:1789265482.433125:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265482.433128:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433134:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef818ff9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433146:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433157:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433163:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433167:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265482.433171:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433177:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433184:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540cd7af00) 00010000:00010000:1.0:1789265482.433186:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265482.433189:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433195:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef818ffa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433240:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef818ff96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f867a expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433254:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818ffab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f867a expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.433261:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:1.0:1789265482.433263:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265482.433271:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f600, rc 0) 00000100:00100000:1.0:1789265482.433400:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11468:x1876180533847424:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1091us (1366us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789265482.433408:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 165 00000100:00100000:0.0:1789265482.438632:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265482.438735:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533847552 00000100:00100000:2.0:1789265482.438748:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533847552 00000100:00100000:2.0:1789265482.438821:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:2.0:1789265482.438830:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11468:x1876180533847552:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:2.0:1789265482.438904:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.438930:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.438962:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.438990:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.438997:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.439126:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.439133:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265482.439137:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.439145:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.439160:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:2.0:1789265482.439163:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265482.439169:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.439176:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef818ffb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265482.439325:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11468:x1876180533847552:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 495us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265482.439380:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:0.0:1789265482.443294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265482.447350:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533847680 00000100:00100000:1.0:1789265482.447610:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533847680 00000100:00100000:1.0:1789265482.447764:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1789265482.447777:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:2344:x1876180533847680:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265482.447809:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265482.447837:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef818ffab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f867a expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265482.447860:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:1.0:1789265482.447865:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265482.447990:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:2344:x1876180533847680:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 215us (4706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.447998:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:2.0:1789265482.449651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265482.449785:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533847936 00000100:00100000:2.0:1789265482.449794:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533847936 00000100:00100000:2.0:1789265482.449845:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:2.0:1789265482.449855:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:11468:x1876180533847936:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:2.0:1789265482.450839:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11468:x1876180533847936:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 981us (1190us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789265482.450850:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:2.0:1789265482.658555:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265482.658635:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265482.658660:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553770752:0@lo:400:kworker.0 00000100:00100000:3.0:1789265482.658754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265482.660656:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553770752 00000100:00100000:0.0:1789265482.660673:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553770752 00000100:00100000:0.0:1789265482.660773:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265482.660785:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553770752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.660894:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553770752:12345-0@lo:400:kworker.0 Request processed in 111us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.660902:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265482.660967:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553770752:0@lo:400:kworker.0 00000100:00100000:2.0:1789265482.664563:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553770624:0@lo:400:kworker.0 00000100:00100000:2.0:1789265482.664652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.666129:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553770880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.666185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.666219:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265482.666226:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553771008:0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.666253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.666288:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553771008 00000100:00100000:1.0:1789265482.666309:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553771008 00000100:00100000:0.0:1789265482.666496:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553771136:0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.666528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265482.666552:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265482.666557:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553771264:0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.666578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265482.666605:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553771264 00000100:00100000:0.0:1789265482.666608:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553771264 00000100:00100000:1.0:1789265482.666667:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789265482.666677:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553770880 00000100:00100000:1.0:1789265482.666677:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553771008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265482.666681:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553770880 00000100:00100000:1.0:1789265482.666815:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553771008:12345-0@lo:400:kworker.0 Request processed in 139us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.666923:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265482.667876:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553770624 00000100:00100000:3.0:1789265482.667900:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553770624 00000100:00100000:3.0:1789265482.668140:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789265482.668152:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553770624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.668628:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265482.668638:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553771264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265482.668695:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553770624:12345-0@lo:400:kworker.0 Request processed in 547us (4043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265482.668703:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789265482.668789:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553771264:12345-0@lo:400:kworker.0 Request processed in 80us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.668796:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265482.668937:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553771264:0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.668999:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553771136 00000100:00100000:0.0:1789265482.669054:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553771136 00000100:00100000:0.0:1789265482.669091:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265482.669115:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553771136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.669158:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553771136:12345-0@lo:400:kworker.0 Request processed in 44us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.669164:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265482.669191:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553771136:0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.669232:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553771008:0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.669269:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553770624:0@lo:400:kworker.0 00000100:00080000:1.0:1789265482.670021:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265482.670029:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265482.670031:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265482.670134:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789265482.670147:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553770880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265482.670950:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553770880:12345-0@lo:400:kworker.0 Request processed in 803us (4759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265482.670958:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265482.671042:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553770880:0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.698501:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265482.698605:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533848192 00000100:00100000:3.0:1789265482.698623:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533848192 00000100:00100000:3.0:1789265482.698705:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 167 00000100:00100000:3.0:1789265482.698717:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11486:x1876180533848192:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:3.0:1789265482.698749:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265482.698780:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ffc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8681 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.698943:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ffc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.698962:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ffc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.698977:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ffc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265482.698992:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789265482.699194:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef818ffc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8681 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.699222:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ffc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8681 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265482.699233:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:3.0:1789265482.699237:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789265482.699241:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884800, rc 0) 00000100:00100000:3.0:1789265482.699320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11486:x1876180533848192:12345-192.168.204.43@tcp:101:cat.0 Request processed in 605us (838us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789265482.699328:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 167 00000100:00100000:2.0:1789265482.745653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265482.746041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533848320 00000100:00100000:0.0:1789265482.746058:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533848320 00000100:00100000:0.0:1789265482.746142:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 168 00000100:00100000:0.0:1789265482.746154:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11487:x1876180533848320:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265482.746184:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265482.746209:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818ffd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8688 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.746298:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818ffdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.746314:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818ffdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.746327:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818ffdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265482.748354:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789265482.748368:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265482.748420:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818ffdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.748483:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818ffd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8688 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.748507:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818ffdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8688 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.748517:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:0.0:1789265482.748520:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265482.748524:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995000, rc 0) 00000100:00100000:0.0:1789265482.748643:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11487:x1876180533848320:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 2490us (3008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.748652:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 168 00000100:00100000:1.0:1789265482.757037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265482.757159:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533848704 00000100:00100000:0.0:1789265482.757175:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533848704 00000100:00100000:0.0:1789265482.757405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:0.0:1789265482.757419:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11487:x1876180533848704:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265482.757969:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11487:x1876180533848704:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 550us (953us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789265482.759712:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:2.0:1789265482.761686:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265482.761760:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533848832 00000100:00100000:0.0:1789265482.761774:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533848832 00000100:00100000:0.0:1789265482.761850:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:0.0:1789265482.761868:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11487:x1876180533848832:12345-192.168.204.43@tcp:103:lfs.0 00010000:00010000:0.0:1789265482.761891:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789265482.761953:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ff6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f866c expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.761981:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef818ffc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8681 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.761994:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818fe70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f862d expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.762005:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074700) 00010000:00010000:0.0:1789265482.762017:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265482.762101:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11487:x1876180533848832:12345-192.168.204.43@tcp:103:lfs.0 Request processed in 235us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.762110:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:3.0:1789265482.770933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265482.771392:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533848960 00000100:00100000:2.0:1789265482.771408:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533848960 00000100:00100000:2.0:1789265482.771487:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 169 00000100:00100000:2.0:1789265482.771499:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11487:x1876180533848960:12345-192.168.204.43@tcp:58:lfs.0 00010000:00010000:2.0:1789265482.771665:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.771687:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265482.771729:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265482.772794:0:9189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789265482.773203:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11487:x1876180533848960:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 1698us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265482.773216:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 169 00000100:00100000:1.0:1789265482.818825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265482.818928:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533849088 00000100:00100000:0.0:1789265482.818943:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533849088 00000100:00100000:0.0:1789265482.819024:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 170 00000100:00100000:0.0:1789265482.819035:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11489:x1876180533849088:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265482.819061:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265482.819088:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ffea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f868f expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819182:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819201:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819216:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819253:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819262:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819269:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819697:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819709:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819717:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265482.819769:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789265482.819775:0:9387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265482.819845:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819860:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819870:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819878:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819897:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819905:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265482.819921:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819930:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819946:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:0.0:1789265482.819950:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265482.819954:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819961:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef818fff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819974:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819979:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819985:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.819990:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265482.819992:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.820007:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.820014:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92542b074700) 00010000:00010000:0.0:1789265482.820016:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265482.820018:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.820024:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef818fff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.820062:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef818ffea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 37 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.820076:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 36 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265482.820083:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3a00) 00010000:00010000:0.0:1789265482.820085:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265482.820087:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994c00, rc 0) 00000100:00100000:0.0:1789265482.820236:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11489:x1876180533849088:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1201us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.820245:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 170 00000040:00080000:2.0:1789265483.038600:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265483.038610:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265483.038953:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789265483.038961:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265483.039115:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553771392:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265483.039234:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254071b6900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265483.045885:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553771392:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265483.056645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265483.057732:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533849216 00000100:00100000:1.0:1789265483.057744:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533849216 00000100:00100000:1.0:1789265483.057828:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 171 00000100:00100000:1.0:1789265483.057839:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11500:x1876180533849216:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789265483.057881:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265483.058290:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11500:x1876180533849216:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 451us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265483.058298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 171 00000100:00080000:1.0:1789265483.058329:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265483.063030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.063392:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533849344 00000100:00100000:2.0:1789265483.063406:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533849344 00000100:00100000:2.0:1789265483.063489:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 172 00000100:00100000:2.0:1789265483.063502:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11500:x1876180533849344:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789265483.063623:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063647:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063663:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063770:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063795:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063803:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063840:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063850:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063856:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265483.063917:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789265483.063922:0:9189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265483.063938:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.063951:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064036:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064045:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064051:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265483.064056:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064071:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064087:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:2.0:1789265483.064090:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265483.064096:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064102:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190006 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064117:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064124:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064131:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064137:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265483.064140:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064146:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064154:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff92540ccf3200) 00010000:00010000:2.0:1789265483.064156:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265483.064159:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064176:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef819000d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064195:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064201:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064206:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064211:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265483.064215:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064221:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064229:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3a00) 00010000:00010000:2.0:1789265483.064231:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265483.064234:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.064239:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265483.064374:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11500:x1876180533849344:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 872us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265483.064384:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 172 00000100:00100000:1.0:1789265483.071041:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.071139:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533849600 00000100:00100000:2.0:1789265483.071156:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533849600 00000100:00100000:2.0:1789265483.071237:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 173 00000100:00100000:2.0:1789265483.071250:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11500:x1876180533849600:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265483.071279:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265483.071307:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef819001b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8696 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071474:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071492:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071507:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265483.071521:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789265483.071676:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071685:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071692:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071699:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265483.071705:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071714:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071747:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3a00) 00010000:00010000:2.0:1789265483.071751:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265483.071756:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071763:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071822:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef819001b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8696 expref: 38 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071834:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:2.0:1789265483.071837:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265483.071841:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef819001b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8696 expref: 38 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.071852:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136000, rc 0) 00000100:00100000:2.0:1789265483.071955:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11500:x1876180533849600:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 706us (929us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789265483.071965:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 173 00000100:00100000:1.0:1789265483.078052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.078399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533849728 00000100:00100000:3.0:1789265483.078420:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533849728 00000100:00100000:3.0:1789265483.078514:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 174 00000100:00100000:3.0:1789265483.078530:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11500:x1876180533849728:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265483.078593:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265483.078754:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11500:x1876180533849728:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 227us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265483.078765:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 174 00000100:00100000:0.0:1789265483.087047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.087558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533849984 00000100:00100000:3.0:1789265483.087573:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533849984 00000100:00100000:3.0:1789265483.087762:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 175 00000100:00100000:3.0:1789265483.087777:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11500:x1876180533849984:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265483.087804:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265483.087824:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265483.087860:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef818ffdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8688 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.087883:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:3.0:1789265483.087889:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265483.087920:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190030 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f869d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265483.089960:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789265483.090971:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.090997:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.091013:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.091126:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190030 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f869d expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.091150:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f869d expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.091160:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9000) 00010000:00010000:3.0:1789265483.091164:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265483.091168:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885c00, rc 0) 00000100:00100000:3.0:1789265483.091383:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11500:x1876180533849984:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 3607us (4350us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789265483.093764:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 175 00000100:00100000:1.0:1789265483.103951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265483.103998:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533850240 00000100:00100000:1.0:1789265483.104012:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533850240 00000100:00100000:1.0:1789265483.104086:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 176 00000100:00100000:1.0:1789265483.104098:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11500:x1876180533850240:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265483.104183:0:9387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265483.104221:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f869d expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104253:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9000) 00010000:00010000:1.0:1789265483.104267:0:9387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265483.104299:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104315:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104328:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104382:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104399:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104406:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104813:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104823:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104831:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104837:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fa00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265483.104841:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104856:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104867:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:1.0:1789265483.104871:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265483.104876:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104882:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef8190045 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104893:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104899:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104917:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104923:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265483.104926:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104933:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104941:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x72f46074 (ffff92540cd7af00) 00010000:00010000:1.0:1789265483.104944:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265483.104947:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.104963:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f400/0x8e12577ef819004c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x72f46074 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.105085:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11500:x1876180533850240:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 987us (1149us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265483.105095:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 176 00000100:00100000:2.0:1789265483.111948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.112103:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533850368 00000100:00100000:3.0:1789265483.112129:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533850368 00000100:00100000:3.0:1789265483.112204:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 177 00000100:00100000:3.0:1789265483.112217:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11500:x1876180533850368:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265483.112248:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265483.112285:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86a4 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.112377:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.112573:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.112589:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.112812:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 39 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.112836:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 38 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.112848:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.112852:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265483.112857:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:3.0:1789265483.113005:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11500:x1876180533850368:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 789us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265483.113022:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 177 00000100:00100000:1.0:1789265483.121678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.122261:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533850624 00000100:00100000:2.0:1789265483.122276:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533850624 00000100:00100000:2.0:1789265483.122370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 178 00000100:00100000:2.0:1789265483.122382:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11500:x1876180533850624:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265483.122507:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.122549:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.122564:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265483.122973:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789265483.122986:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338356653533ns, next at 339356650669ns, rc = 0 00000004:00010000:2.0:1789265483.123102:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c93b86c1 reply state 000000000b32f2fc transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265483.123115:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265483.123270:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+40:11500:x1876180533850624:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 887us (1607us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789265483.123279:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 178 00010000:00010000:3.0:1789265483.125189:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.125211:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.125221:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.125228:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265483.125234:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.125243:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.125267:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.125271:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265483.125276:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.125283:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190061 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.127462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.128301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533850752 00000100:00100000:3.0:1789265483.128318:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533850752 00000100:00100000:3.0:1789265483.128468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 179 00000100:00100000:3.0:1789265483.128484:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+39:11500:x1876180533850752:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265483.128520:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265483.128558:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86ab expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.128667:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.128690:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.128722:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.128727:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265483.128731:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884000, rc 0) 00000100:00100000:3.0:1789265483.128833:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+40:11500:x1876180533850752:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 353us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265483.128841:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 179 00000100:00100000:2.0:1789265483.132731:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265483.132802:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533850880 00000100:00100000:1.0:1789265483.132816:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533850880 00000100:00100000:1.0:1789265483.132936:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00080000:2.0:1789265483.132937:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265483.132948:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533850880:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789265483.133716:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533850880:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 765us (995us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789265483.133728:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:1.0:1789265483.138188:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.138680:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533851136 00000100:00100000:2.0:1789265483.138694:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533851136 00000100:00100000:2.0:1789265483.138853:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:2.0:1789265483.138867:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+40:11500:x1876180533851136:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265483.139406:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+41:11500:x1876180533851136:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 539us (1231us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789265483.139415:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:1.0:1789265483.143972:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265483.144880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533851392 00000100:00100000:0.0:1789265483.144895:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533851392 00000100:00100000:0.0:1789265483.145034:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 180 00000100:00100000:0.0:1789265483.145049:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+41:11500:x1876180533851392:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265483.145414:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+41:11500:x1876180533851392:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 366us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265483.145423:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 180 00000100:00100000:1.0:1789265483.150851:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.151000:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533851520 00000100:00100000:2.0:1789265483.151013:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533851520 00000100:00100000:2.0:1789265483.151092:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 181 00000100:00100000:2.0:1789265483.151104:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+41:11500:x1876180533851520:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265483.151160:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265483.151201:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef819006f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86b2 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.151302:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef8190076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.151321:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef8190076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.151414:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef8190076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265483.151482:0:9387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265483.151506:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef8190076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.151553:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef819006f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b2 expref: 43 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.151573:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef8190076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b2 expref: 42 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.151584:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:2.0:1789265483.151587:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265483.151591:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136c00, rc 0) 00000100:00100000:2.0:1789265483.151687:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+42:11500:x1876180533851520:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 585us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265483.151695:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 181 00000100:00100000:1.0:1789265483.155084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265483.155527:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533851648 00000100:00100000:0.0:1789265483.155542:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533851648 00000100:00100000:0.0:1789265483.155789:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:0.0:1789265483.155805:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533851648:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265483.155833:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265483.155862:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86b9 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265483.155995:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6064a, blocks: 0x1 00010000:00010000:0.0:1789265483.156024:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1789265483.156031:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265483.156113:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.156145:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.156164:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994600, rc 0) 00000100:00100000:0.0:1789265483.156310:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533851648:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 508us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265483.156318:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:1.0:1789265483.158793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.158898:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533851904 00000100:00100000:2.0:1789265483.158922:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533851904 00000100:00100000:2.0:1789265483.159003:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 182 00000100:00100000:2.0:1789265483.159015:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+42:11500:x1876180533851904:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265483.159167:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+42:11500:x1876180533851904:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 154us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265483.159176:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 182 00000100:00100000:1.0:1789265483.162884:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265483.163378:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533852032 00000100:00100000:0.0:1789265483.163393:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533852032 00000100:00100000:0.0:1789265483.163604:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:0.0:1789265483.163617:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:11500:x1876180533852032:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265483.163644:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265483.163790:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86c0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.163839:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.163851:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265483.163857:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265483.163864:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.163922:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.163940:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265483.163959:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540121bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1876180553771520:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265483.164141:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254012546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265483.166578:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265483.166611:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553771648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265483.166701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265483.166763:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553771648 00000100:00100000:1.0:1789265483.166772:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553771648 00000100:00100000:3.0:1789265483.167059:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265483.167074:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553771648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265483.167144:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265483.167220:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553771648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265483.167229:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265483.168975:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553771648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265483.172001:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540121bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1876180553771520:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265483.172049:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.172083:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994200, rc 0) 00000100:00100000:0.0:1789265483.172153:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:11500:x1876180533852032:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 8539us (9286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265483.172163:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:1.0:1789265483.176616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265483.178035:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533852160 00000100:00100000:0.0:1789265483.178053:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533852160 00010000:00010000:0.0:1789265483.178125:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265483.178187:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:0.0:1789265483.178200:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2342:x1876180533852160:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265483.178222:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265483.178251:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.178268:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.178306:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16bc59a/0x8e12577ef819007d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b9 expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.178326:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265483.178363:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265483.178375:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.178396:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.178452:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265483.178472:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540121bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1876180553771776:192.168.204.43@tcp:105: 00000100:00100000:0.0:1789265483.178603:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254012546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265483.205950:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540121bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1876180553771776:192.168.204.43@tcp:105: 00010000:00010000:2.0:1789265483.205990:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265483.206065:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533852160:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 27866us (29463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265483.206079:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:2.0:1789265483.206159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.208734:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533852288 00000100:00100000:2.0:1789265483.208758:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533852288 00002000:00100000:2.0:1789265483.208842:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9254377d3100 x1876180533852288/t0(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:54/0 lens 504/0 e 0 to 0 dl 1789265494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265483.208854:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9254377d3100 with x1876180533852288 ext(0->8) 00002000:00010000:2.0:1789265483.208862:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9254377d3100 00000100:00100000:2.0:1789265483.208899:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:2.0:1789265483.208921:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533852288:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789265483.209518:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:2343:x1876180533852288:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 Request processed in 594us (3355us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789265483.209529:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00002000:00100000:2.0:1789265483.209539:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9254377d3100 x1876180533852288/t4294967314(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:54/0 lens 504/448 e 0 to 0 dl 1789265494 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265483.209556:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9254377d3100 with x1876180533852288 ext(0->8) 00002000:00010000:2.0:1789265483.209561:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9254377d3100 00000100:00100000:2.0:1789265483.231151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.231214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533852416 00000100:00100000:2.0:1789265483.231230:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533852416 00000100:00100000:2.0:1789265483.231311:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 183 00000100:00100000:2.0:1789265483.231325:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+42:11500:x1876180533852416:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789265483.244373:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1789265483.244400:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1789265483.244406:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:2.0:1789265483.298797:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789265483.387278:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:1.0:1789265483.387351:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789265483.387651:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789265483.387664:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:1.0:1789265483.387680:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1789265483.387689:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:1.0:1789265483.388024:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553771904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789265483.388263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265483.388701:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:11500:x1876180533852416:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 157374us (157564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265483.388716:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 183 00000100:00100000:3.0:1789265483.395515:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553771904 00000100:00100000:3.0:1789265483.395536:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553771904 00000100:00100000:3.0:1789265483.395661:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265483.395675:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553771904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789265483.395962:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789265483.395967:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789265482 00002000:00010000:3.0:1789265483.395970:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789265483.395972:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789265482 -> 1789265482 00002000:00010000:3.0:1789265483.395974:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789265483.396084:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876180553771904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 412us (7963us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789265483.396092:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265483.396310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265483.396528:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533852544 00000100:00100000:0.0:1789265483.396536:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533852544 00000100:00100000:0.0:1789265483.396576:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:0.0:1789265483.396583:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:2343:x1876180533852544:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789265483.396823:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff925437483800/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789265483.396832:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553771904:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1789265483.441515:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1789265483.441541:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1789265483.441552:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1789265483.441621:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533852544:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 45028us (45304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265483.441645:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:0.0:1789265483.445121:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.445227:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533852800 00000100:00100000:3.0:1789265483.445242:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533852800 00000100:00100000:3.0:1789265483.445360:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 184 00000100:00100000:3.0:1789265483.445376:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:11500:x1876180533852800:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265483.445458:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265483.445497:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef8190076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86b2 expref: 18 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.445521:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.445528:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265483.445571:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.445587:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.445622:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265483.446007:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eaaefb20 reply state 0000000016b495ad transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265483.446020:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265483.446162:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11500:x1876180533852800:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 788us (1057us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789265483.446171:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 184 00000100:00100000:2.0:1789265483.450293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:0.0:1789265483.450296:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.450310:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.450320:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.450327:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265483.450382:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.450392:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.450415:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:0.0:1789265483.450419:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265483.450425:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.450431:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819008b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.450587:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533852928 00000100:00100000:1.0:1789265483.450599:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533852928 00000100:00100000:1.0:1789265483.450730:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:1.0:1789265483.450743:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533852928:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789265483.451104:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789265483.451108:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789265482 -> 1789265481 00002000:00010000:1.0:1789265483.451111:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789265479 00002000:00010000:1.0:1789265483.451113:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789265482 -> 1789265481 00002000:00010000:1.0:1789265483.451115:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789265483.451271:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533852928:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 529us (993us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789265483.451280:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:0.0:1789265483.455017:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.455224:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533853184 00000100:00100000:3.0:1789265483.455239:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533853184 00000100:00100000:3.0:1789265483.455317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 185 00000100:00100000:3.0:1789265483.455375:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:11500:x1876180533853184:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789265483.455478:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.455500:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 18 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.455510:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.455559:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 18 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.455575:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 18 pid: 9189 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265483.455618:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b84a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876180553772032:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265483.455729:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265483.458574:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.458745:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b84a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876180553772032:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265483.458852:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.458949:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533853312 00000100:00100000:1.0:1789265483.458959:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533853312 00010000:00010000:1.0:1789265483.459014:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 19 pid: 9189 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.459081:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:1.0:1789265483.459092:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540517f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:2343:x1876180533853312:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265483.459115:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265483.459123:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 19 pid: 9189 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.459137:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 19 pid: 9189 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.459163:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819005a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86a4 expref: 19 pid: 9189 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.459181:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:1.0:1789265483.459187:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.459197:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.459206:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.459393:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265483.459460:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540517f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:2343:x1876180533853312:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 369us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265483.459468:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 68 00010000:00010000:2.0:1789265483.460968:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.460986:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.461028:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.461036:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.461064:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.461071:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265483.461076:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.461084:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.461102:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:2.0:1789265483.461106:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789265483.461111:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.461117:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190092 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265483.461327:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:11500:x1876180533853184:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 Request processed in 5992us (6320us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789265483.461364:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 185 00000100:00100000:0.0:1789265483.467055:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.468665:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533853440 00000100:00100000:2.0:1789265483.468687:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533853440 00000100:00100000:2.0:1789265483.468924:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:0.0:1789265483.469497:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533853440:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789265483.469565:0:9090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.469593:0:9090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.469603:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265483.469608:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265483.469613:0:9090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.469747:0:9090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.469767:0:9090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 8 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265483.469786:0:9090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925401218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9090:1876180553772160:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265483.469927:0:9090:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543d4b5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265483.473045:0:9090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925401218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9090:1876180553772160:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265483.473110:0:9090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265483.474796:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265483.475106:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533853568 00000100:00100000:1.0:1789265483.475119:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533853568 00010000:00010000:1.0:1789265483.475175:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 9 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.475229:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:1.0:1789265483.475241:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2343:x1876180533853568:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265483.475260:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265483.475290:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 9 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.475306:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 9 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.476654:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000597cdea/0x8e12577ef8190084 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c0 expref: 9 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.476685:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265483.476691:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265483.476699:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.476712:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.476966:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265483.477069:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533853568:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1827us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265483.477081:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00010000:00010000:1.0:1789265483.478067:0:9090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.478084:0:9090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.478134:0:9090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.478144:0:9090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.478153:0:9090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.478160:0:9090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265483.478166:0:9090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.478175:0:9090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.478197:0:9090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.478219:0:9090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d66bdcc5/0x8e12577ef8190099 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.478509:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533853440:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 9568us (11466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265483.478520:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:2.0:1789265483.484646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265483.486103:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533853824 00000100:00100000:1.0:1789265483.486129:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533853824 00000100:00100000:1.0:1789265483.486235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 186 00000100:00100000:1.0:1789265483.486249:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+17:11500:x1876180533853824:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265483.486408:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.486433:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.486449:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.486784:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.486805:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.486822:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.486888:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.486917:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 18 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.486936:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437483b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553772288:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265483.487058:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265483.491930:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437483b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553772288:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265483.491971:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265483.492148:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265483.492250:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533853952 00000100:00100000:1.0:1789265483.492260:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533853952 00010000:00010000:1.0:1789265483.492316:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 19 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.493109:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:1.0:1789265483.493125:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:2343:x1876180533853952:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265483.493143:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265483.493153:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 19 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.493168:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 19 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.493196:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ab expref: 19 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.493214:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:1.0:1789265483.493227:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.493237:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.493246:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.493281:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265483.493359:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.493369:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.493487:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:2343:x1876180533853952:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 365us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265483.493497:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 70 00000001:00080000:3.0:1789265483.493799:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789265483.494119:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789265483.494604:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789265483.494735:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b849180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1876180553772416:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789265483.494938:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265483.495046:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265483.495363:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553772416 00000100:00100000:1.0:1789265483.495374:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553772416 00000100:00100000:1.0:1789265483.495514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265483.495528:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876180553772416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265483.496297:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876180553772416:12345-0@lo:1000:mdt00_000.0 Request processed in 766us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265483.496309:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265483.496328:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789265483.496370:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff925437483800, transno 4294967315 00000100:00100000:3.0:1789265483.496390:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b849180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1876180553772416:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789265483.498417:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789265483.498584:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b849180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1876180553772544:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789265483.498674:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265483.498712:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265483.498778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553772544 00000100:00100000:2.0:1789265483.498787:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553772544 00000100:00100000:2.0:1789265483.498845:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265483.498857:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876180553772544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265483.500304:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1876180553772544:12345-0@lo:1000:mdt00_000.0 Request processed in 1437us (1617us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789265483.500321:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265483.501880:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b849180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1876180553772544:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789265483.501975:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.501990:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.501999:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502007:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265483.502014:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502024:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502046:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.502051:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265483.502058:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502065:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81900a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502111:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502119:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502125:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502141:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265483.502145:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502152:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502162:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3a00) 00010000:00010000:3.0:1789265483.502165:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265483.502168:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502173:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef818ffe3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502215:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502232:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 21 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502242:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502296:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 21 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.502317:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 21 pid: 9387 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265483.502371:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553772672:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265483.502491:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265483.509658:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553772672:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265483.509710:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.510620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.511137:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533854080 00000100:00100000:2.0:1789265483.511150:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533854080 00010000:00010000:2.0:1789265483.511205:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 22 pid: 9387 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265483.511251:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:2.0:1789265483.511263:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:2343:x1876180533854080:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265483.511282:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265483.511289:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 22 pid: 9387 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.511304:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 22 pid: 9387 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.511359:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef818ffff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f868f expref: 22 pid: 9387 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.511379:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3a00) 00010000:00010000:2.0:1789265483.511385:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.511397:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.511406:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.511673:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265483.511747:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:2343:x1876180533854080:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 485us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265483.511755:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 71 00010000:00010000:1.0:1789265483.512037:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512049:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512065:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512087:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512095:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512102:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265483.512108:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512128:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512141:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3a00) 00010000:00010000:1.0:1789265483.512144:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265483.512149:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512156:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81900ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512169:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512175:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512181:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512187:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265483.512195:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512202:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512210:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92540ccf3a00) 00010000:00010000:1.0:1789265483.512212:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265483.512215:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265483.512221:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f600/0x8e12577ef81900a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265483.512859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:11500:x1876180533853824:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 26607us (28237us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1789265483.512870:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 186 00000020:00080000:1.0:1789265483.512875:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789265483.513770:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265483.513779:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265483.515450:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789265483.515476:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265483.516087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.516189:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533854336 00000100:00100000:3.0:1789265483.516204:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533854336 00000100:00100000:3.0:1789265483.516275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:3.0:1789265483.516287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:11500:x1876180533854336:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789265483.517216:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789265483.517327:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789265483.517418:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517441:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517457:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517468:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517476:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517483:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517511:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265483.517645:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:11500:x1876180533854336:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 1355us (1563us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789265483.517665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00000020:00080000:3.0:1789265483.517672:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265483.517756:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265483.517765:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517772:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265483.517777:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517786:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517802:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.517806:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789265483.517811:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517817:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.517833:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265483.517835:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265483.517837:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265483.674865:0:12451:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265483.674884:0:12451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265483.674950:0:12451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789265483.674959:0:12451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265483.858692:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.858798:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533854592 00000100:00100000:3.0:1789265483.858813:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533854592 00000100:00100000:3.0:1789265483.858907:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 187 00000100:00100000:3.0:1789265483.858921:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:11510:x1876180533854592:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265483.858958:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265483.858984:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86c7 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.859136:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81900c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.859155:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81900c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.859186:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81900c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265483.859202:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789265483.859557:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c7 expref: 25 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.859578:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81900c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c7 expref: 24 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.859589:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:3.0:1789265483.859593:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265483.859597:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884200, rc 0) 00000100:00100000:3.0:1789265483.859682:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:11510:x1876180533854592:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 763us (1039us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789265483.859690:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 187 00000100:00100000:2.0:1789265483.865309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.865472:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533854720 00000100:00100000:3.0:1789265483.865486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533854720 00000100:00100000:3.0:1789265483.865565:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 188 00000100:00100000:3.0:1789265483.865579:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:11510:x1876180533854720:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:3.0:1789265483.865691:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.865724:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.865740:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.865761:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.865770:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.865777:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866121:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866131:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866139:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265483.866191:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866208:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866216:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866236:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866244:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265483.866251:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866261:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866279:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:3.0:1789265483.866283:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265483.866289:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866296:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866309:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866316:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866323:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866328:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265483.866473:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866492:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866504:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.866506:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265483.866510:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866516:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866536:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866543:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866549:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866555:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265483.866558:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866565:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866574:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:3.0:1789265483.866578:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265483.866581:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.866597:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265483.866745:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:11510:x1876180533854720:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1165us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265483.866754:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 188 00000100:00100000:1.0:1789265483.915392:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.915541:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533854976 00000100:00100000:3.0:1789265483.915556:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533854976 00000100:00100000:3.0:1789265483.915642:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:3.0:1789265483.915655:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+24:11513:x1876180533854976:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265483.915696:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265483.915725:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86ce expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916283:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916302:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916317:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916372:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916380:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916407:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916932:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916941:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.916950:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265483.916963:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789265483.917289:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917298:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917306:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917313:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265483.917318:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917325:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917376:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:3.0:1789265483.917380:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265483.917394:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917401:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81900ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917416:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917422:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917427:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917431:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265483.917434:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917439:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917446:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff925409ab9b00) 00010000:00010000:3.0:1789265483.917448:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265483.917451:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917456:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81900f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917510:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef81900e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917539:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.917548:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.917551:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265483.917553:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885c00, rc 0) 00000100:00100000:3.0:1789265483.917648:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11513:x1876180533854976:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1996us (2323us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789265483.917660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:1.0:1789265483.921212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265483.921291:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533855104 00000100:00100000:2.0:1789265483.921307:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533855104 00000100:00100000:2.0:1789265483.921442:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:2.0:1789265483.921580:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11513:x1876180533855104:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:2.0:1789265483.922326:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922388:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922406:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922444:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922513:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922542:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922549:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265483.922554:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922563:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922581:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:2.0:1789265483.922586:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265483.922591:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265483.922598:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265483.922849:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11513:x1876180533855104:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 1270us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265483.922859:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:2.0:1789265483.930641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.930722:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533855360 00000100:00100000:3.0:1789265483.930741:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533855360 00000100:00100000:3.0:1789265483.930882:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:3.0:1789265483.930907:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11513:x1876180533855360:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265483.931655:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:11513:x1876180533855360:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 748us (1029us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789265483.931665:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:1.0:1789265483.975983:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265483.976243:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533855616 00000100:00100000:3.0:1789265483.976257:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533855616 00000100:00100000:3.0:1789265483.976578:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 191 00000100:00100000:3.0:1789265483.976596:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:11047:x1876180533855616:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265483.976632:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265483.977286:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190110 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86d5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.977506:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.977543:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.977555:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.977604:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.977623:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 28 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265483.977641:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876180553772800:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265483.978575:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437043240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265483.982438:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265483.982582:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533855744 00000100:00100000:0.0:1789265483.982595:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533855744 00000100:00100000:3.0:1789265483.982653:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1876180553772800:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265483.982658:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 29 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.982694:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265483.982724:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:0.0:1789265483.982738:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:2343:x1876180533855744:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265483.982757:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265483.982781:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 29 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.982795:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 29 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.982822:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81900fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ce expref: 29 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.982839:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:0.0:1789265483.982846:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.982857:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.982865:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265483.982911:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265483.983047:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:2343:x1876180533855744:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 312us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265483.983055:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 72 00010000:00010000:3.0:1789265483.983542:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.983553:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265483.983581:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789265483.983876:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190110 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.984640:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265483.984650:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:3.0:1789265483.984654:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265483.984657:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884000, rc 0) 00000100:00100000:3.0:1789265483.985233:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:11047:x1876180533855616:12345-192.168.204.43@tcp:101:bash.0 Request processed in 8178us (8801us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789265483.985247:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 191 00000100:00100000:1.0:1789265484.002836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.002988:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533856000 00000100:00100000:3.0:1789265484.003002:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533856000 00000100:00100000:3.0:1789265484.003082:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 192 00000100:00100000:3.0:1789265484.003094:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:11047:x1876180533856000:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:3.0:1789265484.003826:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.003856:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.003873:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265484.004116:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789265484.004158:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db0a0da7 reply state 000000003ed4a98d transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265484.004320:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789265484.004764:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789265484.004974:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11047:x1876180533856000:12345-192.168.204.43@tcp:36:bash.0 Request processed in 1866us (2140us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789265484.004992:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 192 00000020:00080000:2.0:1789265484.005000:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789265484.029633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.030933:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533856128 00000100:00100000:2.0:1789265484.030953:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533856128 00000100:00100000:2.0:1789265484.031085:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 193 00000100:00100000:2.0:1789265484.031099:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11047:x1876180533856128:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265484.031135:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265484.031178:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef819012c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86dc expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.031277:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef819012c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86dc expref: 33 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.031297:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef819012c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86dc expref: 33 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.031327:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:2.0:1789265484.031375:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265484.031382:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136000, rc 0) 00000100:00100000:2.0:1789265484.031479:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+33:11047:x1876180533856128:12345-192.168.204.43@tcp:101:bash.0 Request processed in 383us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265484.031487:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 193 00010000:00010000:0.0:1789265484.031685:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.031695:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.031703:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.031723:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265484.031730:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.031740:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.031758:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:0.0:1789265484.031761:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265484.031765:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.031773:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190125 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265484.044882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.046740:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533856256 00000100:00100000:3.0:1789265484.046767:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533856256 00000100:00100000:3.0:1789265484.046876:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:3.0:1789265484.046899:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:11047:x1876180533856256:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265484.046930:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265484.047329:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86e3 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265484.047417:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa60649, atime: 0x6aa60647, ctime: 0x6aa60649, blocks: 0xb 00010000:00010000:3.0:1789265484.047522:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1789265484.047529:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265484.047541:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.047566:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.047584:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:3.0:1789265484.047685:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:11047:x1876180533856256:12345-192.168.204.43@tcp:101:bash.0 Request processed in 797us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265484.047694:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:1.0:1789265484.052512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.052670:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533856384 00000100:00100000:3.0:1789265484.052685:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533856384 00002000:00010000:3.0:1789265484.052757:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1789265484.052763:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925437483b80 with x1876180533856384 ext(0->18446744073709551615) 00002000:00010000:3.0:1789265484.052778:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925437483b80. 00000100:00100000:3.0:1789265484.052820:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:3.0:1789265484.052850:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533856384:12345-192.168.204.43@tcp:10:bash.0 00002000:00010000:3.0:1789265484.053280:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789265484.053284:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789265481 -> 1789265483 00002000:00010000:3.0:1789265484.053287:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789265479 -> 1789265479 00002000:00010000:3.0:1789265484.053289:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789265481 -> 1789265483 00002000:00010000:3.0:1789265484.053292:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789265484.053410:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2342:x1876180533856384:12345-192.168.204.43@tcp:10:bash.0 Request processed in 560us (912us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789265484.053419:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00002000:00010000:3.0:1789265484.053423:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1789265484.053426:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925437483b80 with x1876180533856384 ext(0->18446744073709551615) 00002000:00010000:3.0:1789265484.053431:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925437483b80. 00000100:00100000:1.0:1789265484.194906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.195202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533856512 00000100:00100000:2.0:1789265484.195220:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533856512 00000100:00100000:2.0:1789265484.195312:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 194 00000100:00100000:2.0:1789265484.195359:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11527:x1876180533856512:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:2.0:1789265484.195613:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.195639:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.195679:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.195703:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.195711:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.195719:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196087:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196098:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196106:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265484.196174:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196189:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196196:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196203:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196234:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.196240:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196249:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196267:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265484.196270:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265484.196276:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196281:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819013a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196297:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196302:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196309:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196314:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.196316:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196321:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196625:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3400) 00010000:00010000:2.0:1789265484.196628:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265484.196632:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196639:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196662:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196668:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196674:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196679:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.196682:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196688:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196696:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:2.0:1789265484.196698:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265484.196702:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.196707:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265484.196898:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11527:x1876180533856512:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1561us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265484.196908:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 194 00000100:00100000:1.0:1789265484.268715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.269262:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533856768 00000100:00100000:2.0:1789265484.269278:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533856768 00000100:00100000:2.0:1789265484.269424:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 195 00000100:00100000:2.0:1789265484.269438:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543775fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+32:11530:x1876180533856768:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265484.269484:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265484.269513:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef819014f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86ea expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.269620:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.269639:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.269653:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.269670:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.269678:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.269685:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270246:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270258:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270264:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265484.270278:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789265484.270440:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270448:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270454:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270462:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.270468:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270477:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270491:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265484.270494:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265484.270499:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270517:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270532:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270537:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270543:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270548:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.270551:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270557:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270564:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3400) 00010000:00010000:2.0:1789265484.270567:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265484.270570:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270577:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819015d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef819014f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ea expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270649:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ea expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.270662:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:2.0:1789265484.270665:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265484.270667:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137200, rc 0) 00000100:00100000:2.0:1789265484.270778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543775fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11530:x1876180533856768:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1342us (2077us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789265484.270788:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 195 00000100:00100000:1.0:1789265484.275830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.277324:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533856896 00000100:00100000:3.0:1789265484.277396:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533856896 00000100:00100000:3.0:1789265484.277504:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 196 00000100:00100000:3.0:1789265484.277518:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11530:x1876180533856896:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:3.0:1789265484.277638:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.277660:0:9189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.277671:0:9189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.277723:0:9189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.277776:0:9189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 34 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265484.277796:0:9189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553772928:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265484.277935:0:9189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265484.290857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.292634:0:9189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553772928:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265484.292680:0:9189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265484.298033:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533857152 00000100:00100000:2.0:1789265484.298059:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533857152 00000100:00100000:2.0:1789265484.298149:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:2.0:1789265484.298165:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:9945:x1876180533857152:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789265484.298690:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:9945:x1876180533857152:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 526us (7847us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789265484.298701:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:2.0:1789265484.302989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265484.303169:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533857280 00000100:00100000:0.0:1789265484.303185:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533857280 00010000:00010000:0.0:1789265484.303248:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 36 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265484.303306:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:0.0:1789265484.303319:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:2342:x1876180533857280:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265484.303379:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265484.303388:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 36 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.303404:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 36 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.303456:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190117 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86d5 expref: 36 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.303475:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:0.0:1789265484.303481:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.303491:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.303500:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.303539:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265484.303610:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:2342:x1876180533857280:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 293us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265484.303620:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 73 00010000:00010000:2.0:1789265484.304289:0:9189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.304302:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.304378:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.304386:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.304393:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.304409:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.304415:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.304423:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.304439:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:2.0:1789265484.304443:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265484.304447:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.304454:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265484.304533:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11530:x1876180533856896:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 27015us (28717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265484.304542:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 196 00000100:00100000:2.0:1789265484.307844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.307947:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533857536 00000100:00100000:3.0:1789265484.307962:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533857536 00000100:00100000:3.0:1789265484.308047:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:3.0:1789265484.308059:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+34:11530:x1876180533857536:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265484.308416:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11530:x1876180533857536:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 358us (586us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789265484.308425:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00010000:00010000:3.0:1789265484.319489:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265484.449487:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.449743:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533857792 00000100:00100000:2.0:1789265484.449758:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533857792 00000100:00100000:2.0:1789265484.449856:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 197 00000100:00100000:2.0:1789265484.449869:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+35:11541:x1876180533857792:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:2.0:1789265484.449910:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265484.449939:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190179 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450057:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450092:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450107:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450127:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450135:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450143:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450545:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef819018e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450555:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef819018e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450563:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef819018e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265484.450574:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789265484.450695:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450704:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450711:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450726:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.450731:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450741:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450757:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265484.450761:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265484.450766:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450773:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef8190180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450785:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450792:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450798:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450804:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.450807:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450813:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450834:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3400) 00010000:00010000:2.0:1789265484.450837:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265484.450840:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450847:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef8190187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450915:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f1 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450933:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef819018e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f1 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.450941:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:2.0:1789265484.450944:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265484.450947:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137400, rc 0) 00000100:00100000:2.0:1789265484.451045:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11541:x1876180533857792:12345-192.168.204.43@tcp:101:cat.0 Request processed in 1179us (1574us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789265484.451054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 197 00000100:00100000:0.0:1789265484.460089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.460254:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533858048 00000100:00100000:3.0:1789265484.460268:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533858048 00000100:00100000:3.0:1789265484.460377:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:3.0:1789265484.460390:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11541:x1876180533858048:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:3.0:1789265484.460731:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11541:x1876180533858048:12345-192.168.204.43@tcp:35:cat.0 Request processed in 344us (660us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789265484.460740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:1.0:1789265484.488868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265484.490299:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533858304 00000100:00100000:0.0:1789265484.490317:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533858304 00000100:00100000:0.0:1789265484.490423:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 198 00000100:00100000:0.0:1789265484.490435:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11542:x1876180533858304:12345-192.168.204.43@tcp:36:rm.0 00010000:00010000:0.0:1789265484.490518:0:9387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789265484.490554:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef819018e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f1 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.490580:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef8190164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ea expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.490610:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef819012c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86dc expref: 36 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.490622:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff925409ab9e00) 00010000:00010000:0.0:1789265484.490634:0:9387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265484.490664:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.490679:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.491473:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.491497:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.491506:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.491514:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.492954:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.492974:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.492986:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265484.494748:0:9387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1789265484.494845:0:9387:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339728511751ns, next at 340728507126ns, rc = 0 00010000:00010000:0.0:1789265484.494958:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.494977:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.494990:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.494999:0:9387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495006:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495012:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495125:0:9387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265484.495157:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495164:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495171:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495178:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265484.495195:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495204:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495221:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074800) 00010000:00010000:0.0:1789265484.495225:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789265484.495230:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495236:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81901aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495274:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495280:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495285:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495290:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265484.495292:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495299:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495306:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:0.0:1789265484.495308:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265484.495317:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.495360:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef819019c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265484.495373:0:9387:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b7fd891 reply state 00000000e9192c71 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265484.495385:0:9387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265484.495542:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+37:11542:x1876180533858304:12345-192.168.204.43@tcp:36:rm.0 Request processed in 5103us (6681us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789265484.495554:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 198 00010000:00010000:0.0:1789265484.498209:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.498399:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.498407:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.498415:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265484.498420:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.498434:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.498463:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92542b074000) 00010000:00010000:0.0:1789265484.498467:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265484.498472:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.498498:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef81901a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.502402:0:11652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265484.502430:0:11652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.502448:0:11652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265484.502454:0:11652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.502465:0:11652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.502489:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92542b074800) 00010000:00010000:1.0:1789265484.502494:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265484.502499:0:11652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.502506:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994a00/0x8e12577ef81901b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.502538:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265484.502540:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265484.502542:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265484.571993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.572149:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533858560 00000100:00100000:2.0:1789265484.572164:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533858560 00000100:00100000:2.0:1789265484.572250:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 199 00000100:00100000:2.0:1789265484.572264:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+36:11548:x1876180533858560:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265484.572311:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265484.572385:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81901b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86f8 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.572586:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.572604:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.572617:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.572634:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.572640:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.572647:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265484.576700:0:9189:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789265484.576960:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577281:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577304:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577396:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577421:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577428:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577434:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265484.577440:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577460:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577476:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265484.577480:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265484.577486:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577494:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265484.577511:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dad7854a reply state 0000000081099464 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265484.577522:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265484.577570:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81901b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 39 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577590:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 38 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.577609:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92540ccf3600) 00010000:00010000:2.0:1789265484.577611:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265484.577614:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136000, rc 0) 00000100:00100000:2.0:1789265484.577729:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+39:11548:x1876180533858560:12345-192.168.204.43@tcp:101:bash.0 Request processed in 5467us (5751us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789265484.577738:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 199 00010000:00010000:0.0:1789265484.586326:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.586385:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.586394:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.586401:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265484.586407:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.586416:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.586444:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3400) 00010000:00010000:0.0:1789265484.586449:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265484.586455:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.586462:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81901c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265484.595045:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265484.597285:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533858688 00000100:00100000:0.0:1789265484.597307:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533858688 00000100:00100000:0.0:1789265484.597441:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:0.0:1789265484.597456:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2342:x1876180533858688:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265484.597498:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265484.597526:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f86ff expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265484.597564:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789265484.597591:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1789265484.597596:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265484.597608:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.597634:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.597652:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995000, rc 0) 00000100:00100000:0.0:1789265484.597821:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533858688:12345-192.168.204.43@tcp:101:bash.0 Request processed in 368us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265484.597830:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00080000:2.0:1789265484.597938:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265484.601328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265484.602631:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533858816 00000100:00100000:0.0:1789265484.602650:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533858816 00000100:00100000:0.0:1789265484.602741:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:0.0:1789265484.602754:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:11548:x1876180533858816:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265484.602781:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265484.602807:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8706 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.602851:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.602888:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265484.602894:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265484.602900:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.602949:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.602965:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 7 pid: 6681 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265484.602983:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925401218000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1876180553773056:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265484.603136:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543d4b5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265484.612053:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925401218000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1876180553773056:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265484.612108:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.612139:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995c00, rc 0) 00000100:00100000:0.0:1789265484.612219:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:11548:x1876180533858816:12345-192.168.204.43@tcp:101:bash.0 Request processed in 9467us (10906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265484.612229:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:2.0:1789265484.614508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.614671:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533858944 00000100:00100000:3.0:1789265484.614697:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533858944 00010000:00010000:3.0:1789265484.614751:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 7 pid: 6681 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265484.614803:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:3.0:1789265484.614815:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533858944:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265484.614833:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265484.614863:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 7 pid: 6681 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.614888:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 7 pid: 6681 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.614918:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a32cf8/0x8e12577ef81901db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86ff expref: 7 pid: 6681 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.614941:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265484.614946:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265484.614957:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.614967:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.615017:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265484.615051:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1876180553773184:192.168.204.43@tcp:105: 00000100:00100000:3.0:1789265484.615151:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265484.618727:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.618833:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533859200 00000100:00100000:2.0:1789265484.618846:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533859200 00000100:00100000:2.0:1789265484.618936:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:2.0:1789265484.618949:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+38:11548:x1876180533859200:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:3.0:1789265484.620072:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1876180553773184:192.168.204.43@tcp:105: 00010000:00010000:3.0:1789265484.620106:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265484.620289:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2342:x1876180533858944:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 5475us (5795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265484.620301:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:2.0:1789265484.620648:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+39:11548:x1876180533859200:12345-192.168.204.43@tcp:35:bash.0 Request processed in 1699us (1937us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789265484.620662:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:1.0:1789265484.823379:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.823543:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533859328 00000100:00100000:2.0:1789265484.823559:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533859328 00000100:00100000:2.0:1789265484.823649:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 200 00000100:00100000:2.0:1789265484.823664:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+39:11564:x1876180533859328:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265484.823698:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265484.823726:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81901e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f870d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.823818:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.823884:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.823913:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265484.823976:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789265484.823981:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265484.824017:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.824053:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81901e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f870d expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.824075:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f870d expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.824087:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265484.824090:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265484.824094:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136200, rc 0) 00000100:00100000:2.0:1789265484.824294:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+40:11564:x1876180533859328:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 632us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265484.824302:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 200 00000100:00100000:1.0:1789265484.843664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265484.844104:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533859584 00000100:00100000:0.0:1789265484.844120:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533859584 00000100:00100000:0.0:1789265484.844207:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 201 00000100:00100000:0.0:1789265484.844239:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+40:11564:x1876180533859584:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265484.844275:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265484.844307:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef81901f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8714 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.844553:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81901fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.844574:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81901fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.844589:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81901fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265484.844617:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789265484.844803:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef81901f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8714 expref: 43 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.844824:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81901fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8714 expref: 42 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.844834:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92540ccf3600) 00010000:00010000:0.0:1789265484.844837:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265484.844841:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994c00, rc 0) 00000100:00100000:0.0:1789265484.844939:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+42:11564:x1876180533859584:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 703us (1296us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789265484.844947:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 201 00000100:00100000:0.0:1789265484.849253:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.849419:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533859840 00000100:00100000:2.0:1789265484.849435:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533859840 00000100:00100000:2.0:1789265484.849522:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 202 00000100:00100000:2.0:1789265484.849535:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+42:11564:x1876180533859840:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265484.849568:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265484.849610:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819020c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f871b expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.849853:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.849884:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.849900:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265484.849916:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789265484.850080:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819020c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f871b expref: 45 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.850099:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f871b expref: 44 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.850110:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92540ccf3600) 00010000:00010000:2.0:1789265484.850113:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265484.850117:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137400, rc 0) 00000100:00100000:2.0:1789265484.850215:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+44:11564:x1876180533859840:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 682us (980us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789265484.850223:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 202 00000100:00100000:2.0:1789265484.853303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265484.854208:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533859968 00000100:00100000:0.0:1789265484.854243:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533859968 00000100:00100000:0.0:1789265484.854470:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1789265484.854484:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540517cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+44:2342:x1876180533859968:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265484.854516:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265484.854551:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81901fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8714 expref: 44 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.854574:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92540ccf3600) 00010000:00010000:0.0:1789265484.854580:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265484.856290:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540517cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+43:2342:x1876180533859968:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1793us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265484.856305:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:1.0:1789265484.860099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265484.860277:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533860096 00000100:00100000:0.0:1789265484.860292:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533860096 00000100:00100000:0.0:1789265484.860704:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:0.0:1789265484.860718:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+6:2343:x1876180533860096:12345-192.168.204.43@tcp:1:lfs.0 00010000:00010000:0.0:1789265484.860793:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.860826:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.860836:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789265484.860843:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265484.860849:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.860942:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265484.860960:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 6 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265484.860978:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540121b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1876180553773312:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265484.861117:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265484.863427:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540121b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1876180553773312:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265484.863468:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265484.867047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.867260:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533860224 00000100:00100000:2.0:1789265484.867274:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533860224 00002000:00100000:2.0:1789265484.867419:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff92543bfbf480 x1876180533860224/t0(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:55/0 lens 504/0 e 0 to 0 dl 1789265495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265484.867455:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543bfbf480 with x1876180533860224 ext(0->8) 00010000:00010000:2.0:1789265484.867470:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 7 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.867491:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 7 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265484.867502:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92543bfbf480 00000100:00100000:2.0:1789265484.867545:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:2.0:1789265484.867558:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533860224:12345-192.168.204.43@tcp:4:lfs.0 00000100:00100000:2.0:1789265484.868310:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2342:x1876180533860224:12345-192.168.204.43@tcp:4:lfs.0 Request processed in 749us (1279us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789265484.868364:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00002000:00100000:2.0:1789265484.868374:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff92543bfbf480 x1876180533860224/t4294967308(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:55/0 lens 504/448 e 0 to 0 dl 1789265495 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265484.868384:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543bfbf480 with x1876180533860224 ext(0->8) 00010000:00010000:2.0:1789265484.868391:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 9 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.868407:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 9 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265484.868414:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92543bfbf480 00000100:00100000:1.0:1789265484.875590:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.876153:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533860352 00000100:00100000:2.0:1789265484.876187:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533860352 00010000:00010000:2.0:1789265484.876247:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 9 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265484.876565:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:2.0:1789265484.876581:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2345:x1876180533860352:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265484.876604:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789265484.876634:0:11653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789265484.876637:0:11653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789265483 00002000:00010000:2.0:1789265484.876639:0:11653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789265484 00002000:00010000:2.0:1789265484.876641:0:11653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789265483 00010000:00010000:2.0:1789265484.876648:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 9 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.876663:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 9 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.876709:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a1efedf/0x8e12577ef81901e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8706 expref: 9 pid: 6680 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.876732:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265484.876737:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265484.876743:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.876763:0:11653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.876815:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265484.876901:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2345:x1876180533860352:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 324us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265484.876909:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 75 00010000:00010000:1.0:1789265484.876982:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.876993:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.877032:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.877042:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.877051:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.877060:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995200 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265484.877065:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.877075:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.877099:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265484.877106:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000604cd7f9/0x8e12577ef8190221 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265484.877164:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533860096:12345-192.168.204.43@tcp:1:lfs.0 Request processed in 16450us (17083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265484.877172:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:1.0:1789265484.886258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.886373:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533860608 00000100:00100000:2.0:1789265484.886388:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533860608 00000100:00100000:2.0:1789265484.886463:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:2.0:1789265484.886475:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+43:11564:x1876180533860608:12345-192.168.204.43@tcp:35:lfs.0 00000004:00010000:2.0:1789265484.886575:0:12056:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f871b expref: 43 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265484.886971:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1789265484.887158:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789265484.887636:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1789265484.887992:0:12056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.888016:0:12056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 47 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.888027:0:12056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.888079:0:12056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 47 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.888097:0:12056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 47 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265484.888133:0:12056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12056:1876180553773440:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265484.888262:0:12056:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a847000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265484.890949:0:12056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12056:1876180553773440:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265484.890988:0:12056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265484.892912:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.893385:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533860736 00000100:00100000:3.0:1789265484.893397:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533860736 00010000:00010000:3.0:1789265484.893454:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 48 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265484.893496:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:3.0:1789265484.893507:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+48:2342:x1876180533860736:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265484.893525:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265484.893533:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 48 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.893549:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 48 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.893578:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136000/0x8e12577ef81901cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86f8 expref: 48 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.893595:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92540ccf3600) 00010000:00010000:3.0:1789265484.893615:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.893627:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.893635:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.893675:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265484.893910:0:12056:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265484.893919:0:12056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265484.894096:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789265484.894393:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1789265484.894533:0:12056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12056:1876180553773568:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789265484.894615:0:12056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265484.894653:0:12056:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543d4b5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265484.894746:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553773568 00000100:00100000:0.0:1789265484.894766:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553773568 00000100:00100000:0.0:1789265484.894838:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265484.894848:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12056:x1876180553773568:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789265484.894951:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12056:x1876180553773568:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 105us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265484.894959:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265484.895245:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+49:2342:x1876180533860736:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 244us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265484.895256:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00080000:2.0:1789265484.896802:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265484.896907:0:12056:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1789265484.896917:0:12056:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1789265484.896943:0:12056:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92543bbde300, transno 4294967307 00000100:00100000:2.0:1789265484.896959:0:12056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12056:1876180553773568:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789265484.897668:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789265484.897778:0:12056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925407251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12056:1876180553773696:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789265484.897880:0:12056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265484.897932:0:12056:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265484.898233:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553773696 00000100:00100000:1.0:1789265484.898242:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553773696 00000100:00100000:1.0:1789265484.898321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265484.898363:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12056:x1876180553773696:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789265484.898616:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12056:x1876180553773696:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 283us (744us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789265484.898625:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265484.898760:0:12056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925407251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12056:1876180553773696:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1789265484.898848:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1789265484.898914:0:12056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.898928:0:12056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.898937:0:12056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.898944:0:12056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265484.898950:0:12056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.898959:0:12056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.898979:0:12056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92540ccf3600) 00010000:00010000:3.0:1789265484.898994:0:12056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789265484.899000:0:12056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.899007:0:12056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190228 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265484.899238:0:12056:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789265484.899447:0:12056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789265484.899461:0:12056:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340133128581ns, next at 341133125889ns, rc = 0 00000001:00080000:3.0:1789265484.899469:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1789265484.899511:0:12056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92540ccf3600) 00010000:00010000:3.0:1789265484.899514:0:12056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265484.899522:0:12056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f871b expref: 51 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265484.899664:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+50:11564:x1876180533860608:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 13191us (13422us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789265484.899673:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00000020:00080000:3.0:1789265484.899679:0:12056:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789265484.903282:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265484.903522:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533860864 00000100:00100000:3.0:1789265484.903537:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533860864 00000100:00100000:3.0:1789265484.903661:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 203 00000100:00100000:3.0:1789265484.903675:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+50:11564:x1876180533860864:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265484.903720:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265484.903764:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef819022f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8722 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.903845:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef819022f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8722 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.903892:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef819022f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8722 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265484.903920:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265484.903923:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265484.903928:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884a00, rc 0) 00000100:00100000:3.0:1789265484.904010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+51:11564:x1876180533860864:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 339us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265484.904018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 203 00000100:00100000:1.0:1789265484.911302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265484.915571:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533861120 00000100:00100000:2.0:1789265484.915594:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533861120 00000100:00100000:2.0:1789265484.915740:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:2.0:1789265484.915764:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+51:11564:x1876180533861120:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:2.0:1789265484.916134:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+52:11564:x1876180533861120:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 381us (4862us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789265484.916143:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:1.0:1789265485.037692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.039833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533861248 00000100:00100000:3.0:1789265485.039853:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533861248 00000100:00100000:3.0:1789265485.040030:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 204 00000100:00100000:3.0:1789265485.040046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+52:11575:x1876180533861248:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:3.0:1789265485.040201:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040227:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040242:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040262:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040270:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040303:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040715:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040725:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040735:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265485.040791:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040807:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040815:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040823:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040830:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.040836:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040845:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040859:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:3.0:1789265485.040882:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265485.040889:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040896:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040910:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040916:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040922:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040926:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.040929:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040934:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040941:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff925409ab9200) 00010000:00010000:3.0:1789265485.040944:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265485.040946:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040951:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef819023d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040966:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040976:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040982:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040988:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.040991:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.040997:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.041006:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.041009:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265485.041012:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.041018:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.041142:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+52:11575:x1876180533861248:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1097us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.041230:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 204 00000100:00080000:2.0:1789265485.047584:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265485.117512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.117662:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533861504 00000100:00100000:2.0:1789265485.117676:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533861504 00000100:00100000:2.0:1789265485.117827:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 205 00000100:00100000:2.0:1789265485.117842:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+52:11578:x1876180533861504:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265485.117886:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265485.117916:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819024b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8729 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118305:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118376:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118393:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118415:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118423:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118450:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118625:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118635:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118643:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265485.118656:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789265485.118837:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118846:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118853:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118859:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265485.118873:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118882:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118898:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265485.118902:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265485.118916:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118923:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef8190252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118938:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118946:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118953:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118959:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265485.118963:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.118969:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.119222:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3c00) 00010000:00010000:2.0:1789265485.119226:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265485.119230:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.119237:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.119298:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819024b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 55 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.119329:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 54 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.119389:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:2.0:1789265485.119392:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265485.119395:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137a00, rc 0) 00000100:00100000:2.0:1789265485.119509:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:11578:x1876180533861504:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1668us (2010us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789265485.119519:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 205 00000100:00100000:1.0:1789265485.123160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.123248:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533861632 00000100:00100000:3.0:1789265485.123272:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533861632 00000100:00100000:3.0:1789265485.123379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 206 00000100:00100000:3.0:1789265485.123392:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:11578:x1876180533861632:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:3.0:1789265485.123497:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123536:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123550:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123589:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123597:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123604:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123610:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.123615:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123624:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123638:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.123642:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265485.123646:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.123652:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819026e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.124197:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:11578:x1876180533861632:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 802us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.124217:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 206 00000100:00100000:1.0:1789265485.138151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.138230:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533861888 00000100:00100000:3.0:1789265485.138244:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533861888 00000100:00100000:3.0:1789265485.138362:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:3.0:1789265485.138377:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+54:11578:x1876180533861888:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265485.138742:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:11578:x1876180533861888:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 368us (610us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789265485.139099:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:2.0:1789265485.215371:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265485.215414:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553773824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265485.215559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265485.215951:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553773824 00000100:00100000:3.0:1789265485.215965:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553773824 00000100:00100000:3.0:1789265485.216059:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265485.216074:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553773824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265485.216137:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265485.216214:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553773824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.216223:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265485.216357:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553773824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265485.217627:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265485.230822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.231013:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533862144 00000100:00100000:3.0:1789265485.231027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533862144 00000100:00100000:3.0:1789265485.231111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 207 00000100:00100000:3.0:1789265485.231125:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:11588:x1876180533862144:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265485.231160:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265485.231164:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265485.231201:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef81901f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f870d expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.231225:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:3.0:1789265485.231239:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265485.231261:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190275 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8730 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.231746:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.231767:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 55 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.231792:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.231842:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 55 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.231870:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 55 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.231907:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540a4ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553773952:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265485.232038:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a847600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265485.237921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.238078:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540a4ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1876180553773952:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265485.238118:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.240925:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533862272 00000100:00100000:3.0:1789265485.240949:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533862272 00010000:00010000:3.0:1789265485.241013:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 56 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.241063:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:3.0:1789265485.241076:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bbddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+56:2342:x1876180533862272:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265485.241102:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265485.241111:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 56 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.241129:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 56 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.241161:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8729 expref: 56 pid: 9189 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.241182:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.241188:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.241199:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.241208:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.241261:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265485.241383:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:2342:x1876180533862272:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 309us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.241392:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 77 00010000:00010000:1.0:1789265485.243096:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.243114:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265485.243148:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789265485.243733:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190275 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.243762:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.243772:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:1.0:1789265485.243849:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265485.243854:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137800, rc 0) 00000100:00100000:1.0:1789265485.243960:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:11588:x1876180533862144:12345-192.168.204.43@tcp:101:bash.0 Request processed in 12836us (13156us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789265485.243971:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 207 00000100:00100000:1.0:1789265485.248417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.248566:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533862528 00000100:00100000:2.0:1789265485.248582:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533862528 00000100:00100000:2.0:1789265485.248672:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 208 00000100:00100000:2.0:1789265485.248685:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+55:11588:x1876180533862528:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:2.0:1789265485.249314:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.249361:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.249379:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265485.249448:0:9189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1789265485.249473:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fd4f0a9 reply state 000000005d0eb0ee transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.249483:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265485.249612:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+58:11588:x1876180533862528:12345-192.168.204.43@tcp:36:bash.0 Request processed in 927us (1209us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789265485.249878:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 208 00000020:00080000:2.0:1789265485.249902:0:9189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265485.251442:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.251465:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.251487:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.251494:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265485.251501:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.251512:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.251532:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:0.0:1789265485.251548:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265485.251554:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.251561:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef819028a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.254469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.254719:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533862656 00000100:00100000:3.0:1789265485.254734:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533862656 00000100:00100000:3.0:1789265485.254832:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 209 00000100:00100000:3.0:1789265485.254846:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+57:11588:x1876180533862656:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265485.254894:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265485.254927:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190291 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8737 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.255045:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.255066:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.255077:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.255125:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.255143:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 58 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.255160:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876180553774080:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265485.255477:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254377a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265485.273263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.273676:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b9dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876180553774080:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265485.273716:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.277218:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533862784 00000100:00100000:0.0:1789265485.277241:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533862784 00010000:00010000:0.0:1789265485.277306:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 59 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.277590:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:0.0:1789265485.277604:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:2343:x1876180533862784:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265485.277626:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265485.277634:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 59 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.277673:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 59 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.277704:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef819027c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8730 expref: 59 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.277721:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:0.0:1789265485.277728:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.277741:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.277751:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.277801:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265485.277900:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+58:2343:x1876180533862784:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 299us (4655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265485.277908:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00010000:00010000:3.0:1789265485.277958:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.277969:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265485.278043:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789265485.278050:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265485.278080:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.278120:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef8190291 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.278136:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.278144:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.278147:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265485.278150:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884800, rc 0) 00000100:00100000:3.0:1789265485.278201:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+57:11588:x1876180533862656:12345-192.168.204.43@tcp:101:bash.0 Request processed in 23359us (23749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.278210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 209 00000100:00100000:2.0:1789265485.282496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.284692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533863040 00000100:00100000:3.0:1789265485.284743:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533863040 00000100:00100000:3.0:1789265485.284869:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:3.0:1789265485.284883:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+57:11588:x1876180533863040:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:2.0:1789265485.285979:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+58:11588:x1876180533863040:12345-192.168.204.43@tcp:35:bash.0 Request processed in 1091us (3490us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789265485.285991:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00010000:00010000:2.0:1789265485.343203:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265485.370543:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.370644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533863168 00000100:00100000:1.0:1789265485.370658:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533863168 00000100:00100000:1.0:1789265485.371506:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 210 00000100:00100000:1.0:1789265485.371522:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+58:11594:x1876180533863168:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265485.371558:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265485.371591:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef819029f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f873e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.372501:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81902a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.372524:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81902a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.372537:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81902a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265485.372610:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789265485.372615:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265485.372639:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81902a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.372674:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fc00/0x8e12577ef819029f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f873e expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.372710:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81902a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f873e expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.372721:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:1.0:1789265485.372724:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265485.372728:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f000, rc 0) 00000100:00100000:1.0:1789265485.372845:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:11594:x1876180533863168:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1327us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.372855:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 210 00000100:00100000:1.0:1789265485.376653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.376907:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533863296 00000100:00100000:2.0:1789265485.376923:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533863296 00000100:00100000:2.0:1789265485.377000:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 211 00000100:00100000:2.0:1789265485.377012:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:11594:x1876180533863296:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265485.377048:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265485.377081:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81902ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8745 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377200:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377223:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377238:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377258:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377266:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377294:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377726:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81902c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377738:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81902c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377747:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81902c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265485.377891:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789265485.377896:0:9189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265485.377929:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81902c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377944:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81902c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377953:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377960:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377967:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377975:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265485.377979:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.377997:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378014:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:2.0:1789265485.378017:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265485.378024:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378029:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81902b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378045:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378051:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378058:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378062:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265485.378065:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378071:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378079:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92540ccf3c00) 00010000:00010000:2.0:1789265485.378081:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265485.378083:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378100:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378151:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136c00/0x8e12577ef81902ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8745 expref: 61 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378166:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81902c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8745 expref: 60 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.378173:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:2.0:1789265485.378176:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265485.378179:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137e00, rc 0) 00000100:00100000:2.0:1789265485.378290:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11594:x1876180533863296:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1280us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.378299:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 211 00000100:00100000:2.0:1789265485.386505:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.386607:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533863424 00000100:00100000:3.0:1789265485.386623:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533863424 00000100:00100000:3.0:1789265485.386720:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1789265485.386734:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:2344:x1876180533863424:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265485.386765:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265485.386808:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81902c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8745 expref: 60 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.386831:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.386839:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265485.386924:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:2344:x1876180533863424:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 193us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.386933:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1789265485.389027:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.399022:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533863680 00000100:00100000:1.0:1789265485.399071:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533863680 00000100:00100000:1.0:1789265485.399176:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 212 00000100:00100000:1.0:1789265485.399189:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:11594:x1876180533863680:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265485.399214:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265485.399241:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef81902c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f874c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.399405:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.399424:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.399436:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.399479:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.399494:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 60 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.399512:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c339180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876180553774208:192.168.204.43@tcp:104: 00000100:00100000:1.0:1789265485.399640:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265485.402427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.402559:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c339180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1876180553774208:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265485.402598:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.403177:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533863808 00000100:00100000:2.0:1789265485.403188:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533863808 00010000:00010000:2.0:1789265485.403241:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 61 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.403289:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:2.0:1789265485.403300:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:2343:x1876180533863808:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265485.403328:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265485.403362:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 61 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.403396:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 61 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.403425:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8737 expref: 61 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.403444:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:2.0:1789265485.403450:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.403461:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.403470:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.403495:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265485.403557:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:2343:x1876180533863808:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 258us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.403564:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 79 00010000:00010000:3.0:1789265485.403727:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.403736:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265485.403767:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789265485.403979:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e400/0x8e12577ef81902c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.403996:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.404006:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.404009:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265485.404012:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5ec00, rc 0) 00000100:00100000:3.0:1789265485.404045:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11594:x1876180533863680:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 4860us (15283us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789265485.404053:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 212 00000100:00100000:2.0:1789265485.413441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.413793:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533864064 00000100:00100000:3.0:1789265485.413808:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533864064 00000100:00100000:3.0:1789265485.413902:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:3.0:1789265485.413916:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540517f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11594:x1876180533864064:12345-192.168.204.43@tcp:103:lfs.0 00010000:00010000:3.0:1789265485.413938:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265485.413972:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef819022f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8722 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.413995:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.414001:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265485.414086:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540517f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:11594:x1876180533864064:12345-192.168.204.43@tcp:103:lfs.0 Request processed in 173us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.414093:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:3.0:1789265485.425274:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.430467:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533864192 00000100:00100000:1.0:1789265485.430680:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533864192 00000100:00100000:3.0:1789265485.434629:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.434843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.434967:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533864448 00000100:00100000:0.0:1789265485.434986:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533864448 00000100:00100000:0.0:1789265485.435057:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:0.0:1789265485.435069:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2344:x1876180533864448:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265485.435144:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2344:x1876180533864448:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 79us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265485.435152:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00080000:3.0:1789265485.435456:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265485.437697:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 213 00000100:00100000:2.0:1789265485.437719:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:11594:x1876180533864192:12345-192.168.204.43@tcp:58:lfs.0 00010000:00010000:2.0:1789265485.438062:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.438084:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.438113:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.438632:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533864320 00000100:00100000:1.0:1789265485.438664:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533864320 00000100:00100000:0.0:1789265485.438945:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 298 00000100:00100000:0.0:1789265485.438958:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533864320:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265485.439193:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925405dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+13:2344:x1876180533864320:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 236us (4574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265485.439203:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 298 00000040:00080000:2.0:1789265485.440001:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789265485.440100:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:11594:x1876180533864192:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 2384us (14841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.440110:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 213 00000100:00100000:0.0:1789265485.455798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.456008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.456381:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533864704 00000100:00100000:2.0:1789265485.456394:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533864704 00000100:00100000:2.0:1789265485.456507:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 153 00000100:00100000:2.0:1789265485.456520:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533864704:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265485.456620:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2345:x1876180533864704:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 103us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.456629:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 153 00000100:00080000:0.0:1789265485.456964:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265485.457181:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533864576 00000100:00100000:1.0:1789265485.457188:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533864576 00000100:00100000:1.0:1789265485.457238:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:1.0:1789265485.457247:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533864576:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265485.457316:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533864576:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 71us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.457324:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:2.0:1789265485.466767:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.467071:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533864832 00000100:00100000:3.0:1789265485.467087:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533864832 00000100:00100000:3.0:1789265485.467215:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 214 00000100:00100000:3.0:1789265485.467229:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+59:11594:x1876180533864832:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265485.467258:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265485.467287:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8753 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.467434:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.467447:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8753 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.467482:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.467506:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8753 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.467522:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.467527:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265485.467532:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8753 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.467541:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884a00, rc 0) 00000100:00100000:3.0:1789265485.467622:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11594:x1876180533864832:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 396us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.467647:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 214 00000040:00080000:0.0:1789265485.598726:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265485.598739:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265485.598812:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789265485.598821:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265485.599005:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925401219180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553774336:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265485.599174:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265485.616089:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925401219180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553774336:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265485.622957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.625135:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533864960 00000100:00100000:0.0:1789265485.625159:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533864960 00000100:00100000:0.0:1789265485.625260:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 215 00000100:00100000:0.0:1789265485.625273:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254071ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11595:x1876180533864960:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265485.625371:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265485.625533:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254071ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11595:x1876180533864960:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 261us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265485.625542:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 215 00000100:00100000:2.0:1789265485.638090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.638225:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533865088 00000100:00100000:3.0:1789265485.638240:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533865088 00000100:00100000:3.0:1789265485.638422:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 216 00000100:00100000:3.0:1789265485.638436:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11595:x1876180533865088:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789265485.638551:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638573:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638591:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638611:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638618:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638624:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638651:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638659:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638665:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265485.638736:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789265485.638741:0:9189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265485.638758:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638771:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638779:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638786:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638792:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.638797:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638804:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638818:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:3.0:1789265485.638822:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265485.638826:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638833:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81902ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638847:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638874:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638881:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638886:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.638890:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638896:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638906:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff925409ab9200) 00010000:00010000:3.0:1789265485.638908:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265485.638911:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638918:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81902f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638934:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638941:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638947:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638952:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.638964:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638971:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638980:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.638983:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265485.638986:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.638992:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81902fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.639116:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11595:x1876180533865088:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 681us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.639127:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 216 00000100:00100000:2.0:1789265485.651692:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.651823:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533865344 00000100:00100000:3.0:1789265485.651839:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533865344 00000100:00100000:3.0:1789265485.651922:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 217 00000100:00100000:3.0:1789265485.651934:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+60:11595:x1876180533865344:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265485.651964:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265485.651993:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190301 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f875a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652150:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652169:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652204:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265485.652220:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789265485.652397:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652406:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652413:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652420:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.652425:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652433:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652449:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265485.652453:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265485.652459:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.652466:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.654577:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190301 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f875a expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.654602:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:2.0:1789265485.654605:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265485.654611:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884800/0x8e12577ef8190301 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f875a expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.654657:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884800, rc 0) 00000100:00100000:2.0:1789265485.654746:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:11595:x1876180533865344:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 2813us (3069us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789265485.654757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 217 00000100:00100000:2.0:1789265485.660600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.660770:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533865472 00000100:00100000:3.0:1789265485.660786:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533865472 00000100:00100000:3.0:1789265485.660869:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 218 00000100:00100000:3.0:1789265485.660898:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:11595:x1876180533865472:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265485.660955:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265485.661111:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:11595:x1876180533865472:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 216us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.661120:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 218 00000100:00100000:0.0:1789265485.667617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.667966:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533865728 00000100:00100000:3.0:1789265485.667980:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533865728 00000100:00100000:3.0:1789265485.668080:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 219 00000100:00100000:3.0:1789265485.668093:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:11595:x1876180533865728:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265485.668124:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265485.668129:0:9189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265485.668165:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f000/0x8e12577ef81902a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f873e expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.668191:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:3.0:1789265485.668198:0:9189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265485.668218:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190316 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8761 expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265485.669809:0:9189:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789265485.670703:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819031d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.670728:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819031d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.670741:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819031d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.670826:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190316 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8761 expref: 63 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.670850:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819031d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8761 expref: 62 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.670871:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3c00) 00010000:00010000:2.0:1789265485.670874:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265485.670878:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136200, rc 0) 00000100:00100000:2.0:1789265485.670973:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+62:11595:x1876180533865728:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 2882us (3371us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789265485.670984:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 219 00000100:00100000:2.0:1789265485.675221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.675319:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533865984 00000100:00100000:1.0:1789265485.675359:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533865984 00000100:00100000:1.0:1789265485.675425:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 220 00000100:00100000:1.0:1789265485.675438:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+62:11595:x1876180533865984:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265485.675560:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265485.675596:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136200/0x8e12577ef819031d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8761 expref: 62 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675620:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3c00) 00010000:00010000:1.0:1789265485.675633:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265485.675663:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675677:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675702:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675718:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675746:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675753:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675842:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675851:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675869:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675877:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ee00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265485.675882:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675891:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675900:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:1.0:1789265485.675904:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265485.675909:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675916:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef819032b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675926:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675939:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675945:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675951:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265485.675954:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675961:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675969:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x95b5ae0f (ffff92540cd7aa00) 00010000:00010000:1.0:1789265485.675972:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265485.675975:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.675982:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef8190332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x95b5ae0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.677165:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:11595:x1876180533865984:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 1720us (1950us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265485.677179:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 220 00000100:00100000:0.0:1789265485.679929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.680183:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533866112 00000100:00100000:2.0:1789265485.680197:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533866112 00000100:00100000:2.0:1789265485.680270:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 221 00000100:00100000:2.0:1789265485.680283:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+61:11595:x1876180533866112:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265485.680326:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265485.680395:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8768 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.680447:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.680463:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.681028:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.681171:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 63 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.681191:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 62 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.681202:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:2.0:1789265485.681206:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265485.681210:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137a00, rc 0) 00000100:00100000:2.0:1789265485.681449:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+62:11595:x1876180533866112:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1167us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.681875:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 221 00000100:00100000:2.0:1789265485.691285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.691558:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533866368 00000100:00100000:0.0:1789265485.691591:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533866368 00000100:00100000:0.0:1789265485.691724:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 222 00000100:00100000:0.0:1789265485.691749:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+62:11595:x1876180533866368:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265485.691890:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.691913:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.691928:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265485.692289:0:9189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1789265485.692308:0:9189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340925975353ns, next at 341925964507ns, rc = 0 00000004:00010000:0.0:1789265485.692451:0:9189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002592fd3b reply state 000000005c7bab99 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.692464:0:9189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265485.692602:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+64:11595:x1876180533866368:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 865us (1334us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789265485.692610:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 222 00000100:00100000:2.0:1789265485.697674:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.697764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533866496 00000100:00100000:1.0:1789265485.697777:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533866496 00000100:00100000:1.0:1789265485.697845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 223 00000100:00100000:1.0:1789265485.697864:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+64:11595:x1876180533866496:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265485.697895:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265485.697939:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f876f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.698032:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 65 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.698049:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 65 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.698071:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:1.0:1789265485.698075:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265485.698079:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f200, rc 0) 00000100:00100000:1.0:1789265485.698141:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+65:11595:x1876180533866496:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 288us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.698148:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 223 00010000:00010000:3.0:1789265485.701009:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.701181:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.701190:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.701222:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265485.701228:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.701236:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.701258:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:3.0:1789265485.701261:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265485.701268:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.701274:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190347 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.701581:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.701870:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533866624 00000100:00100000:3.0:1789265485.701883:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533866624 00000100:00100000:3.0:1789265485.701990:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:3.0:1789265485.702003:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2344:x1876180533866624:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789265485.702478:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:2344:x1876180533866624:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 466us (892us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789265485.702495:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:2.0:1789265485.706831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.706923:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533866880 00000100:00100000:3.0:1789265485.706936:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533866880 00000100:00100000:3.0:1789265485.707065:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:3.0:1789265485.707079:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+64:11595:x1876180533866880:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265485.707476:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+65:11595:x1876180533866880:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 390us (651us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789265485.707503:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:2.0:1789265485.710839:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.710970:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533867136 00000100:00100000:0.0:1789265485.710985:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533867136 00000100:00100000:0.0:1789265485.711188:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 224 00000100:00100000:0.0:1789265485.711200:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+65:11595:x1876180533867136:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265485.711796:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+65:11595:x1876180533867136:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 595us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265485.711806:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 224 00000100:00100000:2.0:1789265485.714844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.714966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533867264 00000100:00100000:1.0:1789265485.714980:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533867264 00000100:00100000:1.0:1789265485.715181:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 225 00000100:00100000:1.0:1789265485.715195:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+65:11595:x1876180533867264:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265485.715223:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265485.715251:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef8190355 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8776 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.715442:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef819035c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.715461:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef819035c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.715565:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef819035c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265485.715618:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265485.715645:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef819035c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.715676:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef8190355 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8776 expref: 67 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.715695:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef819035c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8776 expref: 66 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.715705:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:1.0:1789265485.715708:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789265485.715713:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5e000, rc 0) 00000100:00100000:1.0:1789265485.715948:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+66:11595:x1876180533867264:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 753us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.715956:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 225 00000100:00100000:2.0:1789265485.722804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.722995:0:9090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533867392 00000100:00100000:1.0:1789265485.723009:0:9090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533867392 00000100:00100000:1.0:1789265485.723085:0:9090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:1.0:1789265485.723099:0:9090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+10:2343:x1876180533867392:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265485.723124:0:9090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265485.723152:0:9090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f877d expref: -99 pid: 9090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265485.723211:0:9090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6064c, blocks: 0x1 00010000:00010000:1.0:1789265485.723240:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1789265485.723246:0:9090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265485.723258:0:9090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 11 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.723279:0:9090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 11 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.723297:0:9090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f400, rc 0) 00000100:00100000:1.0:1789265485.723394:0:9090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:2343:x1876180533867392:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 298us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.723402:0:9090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:2.0:1789265485.726090:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.726187:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533867648 00000100:00100000:0.0:1789265485.726215:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533867648 00000100:00100000:0.0:1789265485.726371:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 226 00000100:00100000:0.0:1789265485.726385:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+66:11595:x1876180533867648:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265485.726543:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+66:11595:x1876180533867648:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 161us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265485.726551:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 226 00000100:00100000:3.0:1789265485.730271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.730430:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533867776 00000100:00100000:2.0:1789265485.730446:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533867776 00000100:00100000:2.0:1789265485.730534:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:2.0:1789265485.730547:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+11:11595:x1876180533867776:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265485.730576:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265485.730607:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8784 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.730659:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 12 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.730670:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265485.730676:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265485.730682:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.730745:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 12 pid: 9090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.730782:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 12 pid: 9090 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.730800:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1876180553774464:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265485.730934:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a847300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265485.733627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.733655:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1876180553774464:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265485.733718:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.733756:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137c00, rc 0) 00000100:00100000:1.0:1789265485.733837:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:11595:x1876180533867776:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 3291us (3580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.733847:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:3.0:1789265485.733998:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533867904 00000100:00100000:3.0:1789265485.734007:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533867904 00010000:00010000:3.0:1789265485.734049:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 12 pid: 9090 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.734090:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:3.0:1789265485.734102:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:2343:x1876180533867904:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265485.734119:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265485.734150:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 12 pid: 9090 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.734166:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 12 pid: 9090 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.734202:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002193b83/0x8e12577ef8190363 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f877d expref: 12 pid: 9090 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.734219:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265485.734224:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265485.734235:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.734248:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.734320:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.734350:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1876180553774592:192.168.204.43@tcp:105: 00000100:00100000:3.0:1789265485.734437:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437043f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265485.738902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.739271:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533868032 00000100:00100000:0.0:1789265485.739285:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533868032 00002000:00100000:0.0:1789265485.739397:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff92543bfbca80 x1876180533868032/t0(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:56/0 lens 504/0 e 0 to 0 dl 1789265496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265485.739410:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543bfbca80 with x1876180533868032 ext(0->12) 00002000:00010000:0.0:1789265485.739417:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92543bfbca80 00000100:00100000:0.0:1789265485.739456:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:0.0:1789265485.739627:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+12:2342:x1876180533868032:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265485.740306:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2342:x1876180533868032:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 Request processed in 826us (1407us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789265485.740317:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00002000:00100000:0.0:1789265485.740327:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff92543bfbca80 x1876180533868032/t4294967320(0) o4->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:56/0 lens 504/448 e 0 to 0 dl 1789265496 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265485.740356:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543bfbca80 with x1876180533868032 ext(0->12) 00002000:00010000:0.0:1789265485.740362:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92543bfbca80 00000100:00100000:2.0:1789265485.740892:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1876180553774592:192.168.204.43@tcp:105: 00010000:00010000:2.0:1789265485.740929:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265485.740970:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:2343:x1876180533867904:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 6871us (7362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.740980:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:2.0:1789265485.743631:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.743720:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533868160 00000100:00100000:0.0:1789265485.743805:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533868160 00000100:00100000:0.0:1789265485.743906:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 227 00000100:00100000:0.0:1789265485.743921:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+66:11595:x1876180533868160:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789265485.812250:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1789265485.812270:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000004:00080000:1.0:1789265485.812309:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1789265485.812402:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92540a847180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789265485.812409:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925435e3c600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9254028f2c00 00000020:00080000:1.0:1789265485.812412:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925435e3c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92540cc22000 00000001:00080000:1.0:1789265485.812451:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789265485.812471:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789265485.812515:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9254377a0f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789265485.812519:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543703ff00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9254377a0780 00000020:00080000:1.0:1789265485.812522:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543703fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92543b8fc800 00000100:00100000:1.0:1789265485.812630:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553774720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789265485.812724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789265485.812972:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789265485.813215:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789265485.813275:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553774720 00000100:00100000:1.0:1789265485.813286:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553774720 00000100:00100000:1.0:1789265485.813434:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265485.813447:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553774720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789265485.813485:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1789265485.813532:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa6064b, atime: 0x6aa6064c, ctime: 0x6aa6064b, blocks: 0x1 00010000:00010000:1.0:1789265485.813544:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.813569:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1789265485.813575:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265485.813584:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.813606:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.813632:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.813640:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.813661:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789265485.814190:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:11595:x1876180533868160:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 70265us (70571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265485.814202:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 227 00010000:00010000:0.0:1789265485.815996:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265485.816017:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.816037:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265485.816044:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.816057:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.816087:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.816095:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002193b83/0x8e12577ef8190371 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.816122:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265485.816125:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265485.816126:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265485.816370:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265485.816474:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265485.816499:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553774976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789265485.816594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265485.817375:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876180553774720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3927us (4648us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789265485.817389:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265485.817420:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553774976 00000100:00100000:1.0:1789265485.817429:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553774976 00000100:00100000:1.0:1789265485.817478:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265485.817487:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876180553774976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789265485.817641:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789265485.817645:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789265484 00002000:00010000:1.0:1789265485.817648:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789265485.817650:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789265484 -> 1789265484 00002000:00010000:1.0:1789265485.817653:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789265485.817689:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553774976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (1096us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789265485.817696:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1789265485.817750:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff925402c4b480/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789265485.817758:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553774976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1789265485.818254:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92540c33bb80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789265485.818262:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553774720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265485.819897:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925402c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553774848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789265485.819984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265485.820060:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553774848 00000100:00100000:3.0:1789265485.820069:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553774848 00000100:00100000:3.0:1789265485.820127:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265485.820137:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876180553774848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789265485.820177:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1789265485.820212:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.820240:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.820250:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789265485.820256:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265485.820262:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.820592:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.820611:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 12 pid: 6678 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.820625:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1876180553775104:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265485.821166:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405fc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265485.821376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.826007:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533868288 00000100:00100000:1.0:1789265485.826047:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533868288 00000100:00100000:1.0:1789265485.826138:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:1.0:1789265485.826152:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+13:2344:x1876180533868288:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789265485.826998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.827027:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533868416 00000100:00100000:3.0:1789265485.827034:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533868416 00010000:00010000:3.0:1789265485.827069:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 14 pid: 6678 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.827102:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:3.0:1789265485.827112:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2343:x1876180533868416:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265485.827127:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265485.827133:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 14 pid: 6678 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.827164:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 14 pid: 6678 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.827204:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265485.827224:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265485.827231:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.827243:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.827271:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265485.827350:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+14:2343:x1876180533868416:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 240us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265485.827359:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 81 00010000:00010000:0.0:1789265485.830457:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000163b429e/0x8e12577ef8190133 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86e3 expref: 13 pid: 6678 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.830493:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1876180553775104:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265485.830530:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.830544:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.830552:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.830565:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.830573:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.830610:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265485.830663:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265485.830674:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.830685:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265485.830691:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.830703:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.830741:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.830749:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7ee441a/0x8e12577ef8190378 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.830794:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265485.830796:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265485.830798:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265485.831620:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1876180553774848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11476us (11629us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789265485.831633:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1789265485.832185:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff925402c48e00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789265485.832194:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925402c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553774848:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789265485.896136:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1789265485.896288:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1789265485.898275:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2344:x1876180533868288:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 72111us (76885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.898291:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:3.0:1789265485.901588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.901716:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533868672 00000100:00100000:1.0:1789265485.901739:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533868672 00000100:00100000:1.0:1789265485.901990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 228 00000100:00100000:1.0:1789265485.902005:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:11595:x1876180533868672:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265485.902084:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265485.902124:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e000/0x8e12577ef819035c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8776 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.902149:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:1.0:1789265485.902155:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265485.902198:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.902215:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.902228:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265485.902634:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008af0ba3 reply state 000000005818d0ef transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.902648:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265485.903178:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:11595:x1876180533868672:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 811us (1239us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789265485.903188:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 228 00000100:00100000:1.0:1789265485.917935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:2.0:1789265485.918321:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.918360:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.918369:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.918375:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fa00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265485.918381:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.918408:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.918431:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:2.0:1789265485.918435:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265485.918440:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.918447:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fa00/0x8e12577ef819037f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.918989:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533868800 00000100:00100000:3.0:1789265485.919006:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533868800 00000100:00100000:3.0:1789265485.919082:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:3.0:1789265485.919096:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2342:x1876180533868800:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789265485.919454:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789265485.919458:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789265484 -> 1789265484 00002000:00010000:3.0:1789265485.919461:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789265484 00002000:00010000:3.0:1789265485.919463:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789265484 -> 1789265484 00002000:00010000:3.0:1789265485.919466:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789265485.919551:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533868800:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 458us (1633us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789265485.919560:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:2.0:1789265485.922490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.922960:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533869056 00000100:00100000:3.0:1789265485.922976:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533869056 00000100:00100000:3.0:1789265485.923055:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 229 00000100:00100000:3.0:1789265485.923068:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:11595:x1876180533869056:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789265485.923169:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.923191:0:9189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 20 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.923218:0:9189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.923266:0:9189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 20 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.923283:0:9189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 20 pid: 9387 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.923313:0:9189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553775232:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265485.923462:0:9189:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405fc2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265485.926771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.927144:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533869184 00000100:00100000:2.0:1789265485.927158:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533869184 00010000:00010000:2.0:1789265485.927218:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 21 pid: 9387 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.927263:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:2.0:1789265485.927275:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:2342:x1876180533869184:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265485.927306:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265485.927315:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 21 pid: 9387 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.927359:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 21 pid: 9387 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.927398:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:2.0:1789265485.927404:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.927433:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.927442:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.927467:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265485.927544:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:2342:x1876180533869184:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 270us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.927553:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 82 00010000:00010000:1.0:1789265485.929112:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137a00/0x8e12577ef8190340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8768 expref: 20 pid: 9387 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.929142:0:9189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553775232:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265485.929184:0:9189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929195:0:9189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929202:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929244:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929251:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929258:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929264:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265485.929269:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929277:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929318:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:1.0:1789265485.929322:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789265485.929327:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.929350:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.929789:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11595:x1876180533869056:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 Request processed in 6720us (7310us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789265485.929801:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 229 00000100:00100000:3.0:1789265485.933994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265485.934114:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533869312 00000100:00100000:0.0:1789265485.934130:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533869312 00000100:00100000:0.0:1789265485.934205:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:0.0:1789265485.934216:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2344:x1876180533869312:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789265485.934279:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.934317:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.934327:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789265485.934368:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265485.934374:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.934420:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.934436:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 8 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.934453:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925401219880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1876180553775360:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265485.934560:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265485.937783:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265485.937927:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925401219880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1876180553775360:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265485.937965:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.938049:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533869440 00000100:00100000:1.0:1789265485.938059:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533869440 00010000:00010000:1.0:1789265485.938106:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 9 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265485.938152:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:1.0:1789265485.938167:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+9:2342:x1876180533869440:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265485.938185:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265485.938215:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 9 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.938229:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 9 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.938260:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064eef5f/0x8e12577ef819036a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8784 expref: 9 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.938304:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265485.938309:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265485.938315:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.938326:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.938645:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265485.938733:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2342:x1876180533869440:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 570us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.938742:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 83 00010000:00010000:3.0:1789265485.940130:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.940153:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.940373:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.940386:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.940395:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.940404:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994c00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265485.940410:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.940421:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.940446:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.940472:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f3713f/0x8e12577ef819038d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.940664:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2344:x1876180533869312:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 6443us (6681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.940675:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:0.0:1789265485.946058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.946158:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533869696 00000100:00100000:2.0:1789265485.946172:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533869696 00000100:00100000:2.0:1789265485.946251:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 230 00000100:00100000:2.0:1789265485.946264:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11595:x1876180533869696:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789265485.946427:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.946451:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.946466:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.947005:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.947021:0:9387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.947030:0:9387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.947102:0:9387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.947119:0:9387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 20 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.947137:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553775488:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265485.947245:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a847900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265485.955497:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553775488:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265485.955608:0:9387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.957088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.957793:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533869824 00000100:00100000:2.0:1789265485.958201:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533869824 00010000:00010000:2.0:1789265485.958267:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 21 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.958417:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:2.0:1789265485.958431:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:2342:x1876180533869824:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265485.958454:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265485.958464:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 21 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.958480:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 21 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.958663:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819034e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f876f expref: 21 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.959141:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:2.0:1789265485.959149:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.959161:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.959170:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.959213:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265485.959313:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:2342:x1876180533869824:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 883us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.959322:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 84 00010000:00010000:0.0:1789265485.960224:0:9387:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.960249:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265485.960765:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1789265485.960971:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1789265485.961022:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1789265485.961133:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9387:1876180553775616:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789265485.961220:0:9387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265485.961268:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265485.961424:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553775616 00000100:00100000:1.0:1789265485.961435:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553775616 00000100:00100000:1.0:1789265485.961491:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265485.961501:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9387:x1876180553775616:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789265485.961614:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9387:x1876180553775616:12345-0@lo:1000:mdt00_004.0 Request processed in 114us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.961622:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265485.962161:0:9387:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1789265485.962168:0:9387:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1789265485.962204:0:9387:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff925402c4b480, transno 4294967321 00000100:00100000:3.0:1789265485.962230:0:9387:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff925402c48e00 x1876180553774848/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789265501 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265485.962244:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9387:1876180553775616:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1789265485.963206:0:9387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789265485.964595:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e70000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9387:1876180553775744:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789265485.965920:0:9387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265485.965987:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405fc2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265485.966080:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553775744 00000100:00100000:1.0:1789265485.966091:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553775744 00000100:00100000:1.0:1789265485.966157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265485.966168:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9387:x1876180553775744:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789265485.966919:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9387:x1876180553775744:12345-0@lo:1000:mdt00_004.0 Request processed in 749us (1111us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789265485.966949:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265485.967169:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e70000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9387:1876180553775744:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1789265485.967232:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967245:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967254:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967260:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265485.967267:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967275:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967308:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3500) 00010000:00010000:0.0:1789265485.967312:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265485.967319:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967326:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef819039b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967386:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967399:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967406:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967412:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265485.967415:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967422:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967431:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:0.0:1789265485.967434:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265485.967443:0:9387:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8753 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967456:0:9387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8753 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967465:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8753 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.967626:0:9387:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8753 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.967645:0:9387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925401219500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553775872:192.168.204.43@tcp:105: 00000100:00100000:0.0:1789265485.967908:0:9387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254098d1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265485.977117:0:9387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925401219500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9387:1876180553775872:192.168.204.43@tcp:105: 00010000:00010000:2.0:1789265485.977162:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977175:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81902de lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977235:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977253:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977266:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977279:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977285:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977291:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977310:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265485.977315:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977322:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977378:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:2.0:1789265485.977382:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265485.977386:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977391:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137e00/0x8e12577ef81903a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977408:0:9387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977415:0:9387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977422:0:9387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977427:0:9387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265485.977430:0:9387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977436:0:9387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977445:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:2.0:1789265485.977448:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265485.977451:0:9387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.977458:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137400/0x8e12577ef8190394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.977833:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:11595:x1876180533869696:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 31568us (31786us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789265485.977854:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 230 00000020:00080000:2.0:1789265485.977863:0:9387:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265485.978115:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265485.978122:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265485.978626:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789265485.978636:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265485.980484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265485.981506:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533869952 00000100:00100000:2.0:1789265485.981528:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533869952 00000100:00100000:2.0:1789265485.981629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:2.0:1789265485.981642:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:11594:x1876180533869952:12345-192.168.204.43@tcp:49:lfs.0 00000100:00100000:2.0:1789265485.982943:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:11594:x1876180533869952:12345-192.168.204.43@tcp:49:lfs.0 Request processed in 1291us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.982956:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:0.0:1789265485.986980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265485.987131:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533870208 00000100:00100000:1.0:1789265485.987147:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533870208 00000100:00100000:1.0:1789265485.987227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 231 00000100:00100000:1.0:1789265485.987239:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:11594:x1876180533870208:12345-192.168.204.43@tcp:58:lfs.0 00000040:00080000:1.0:1789265485.988437:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789265485.988623:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:11594:x1876180533870208:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 1380us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.988635:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 231 00000100:00100000:1.0:1789265485.999715:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265486.000010:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533870464 00000100:00100000:3.0:1789265486.000027:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533870464 00000100:00100000:3.0:1789265486.000109:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:3.0:1789265486.000122:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+23:11595:x1876180533870464:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789265486.002139:0:12056:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789265486.002282:0:12056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1789265486.010636:0:12056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.010671:0:12056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.010991:0:12056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.011005:0:12056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.011013:0:12056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.011020:0:12056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.011054:0:12056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265486.011292:0:11652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265486.011307:0:11652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.011315:0:11652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265486.011320:0:11652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.011350:0:11652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.011367:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92540ccf3800) 00010000:00010000:1.0:1789265486.011370:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265486.011375:0:11652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.011382:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137800/0x8e12577ef81903a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.011429:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265486.011432:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265486.011433:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265486.011554:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:11595:x1876180533870464:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 11426us (11858us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789265486.011567:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000020:00080000:2.0:1789265486.011576:0:12056:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789265486.045247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265486.045367:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533870592 00000100:00100000:3.0:1789265486.045382:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533870592 00000100:00100000:3.0:1789265486.045474:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 232 00000100:00100000:3.0:1789265486.045486:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+25:11597:x1876180533870592:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265486.045520:0:9189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265486.045549:0:9189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81903b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f878b expref: -99 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.045656:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.045676:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.045704:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.045758:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.045767:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.045775:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.046103:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.046117:0:9189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.046128:0:9189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.046180:0:9189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265486.046199:0:9189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 26 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265486.046217:0:9189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553776000:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265486.046406:0:9189:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405fc2780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265486.052464:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265486.053111:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533870848 00000100:00100000:3.0:1789265486.053127:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533870848 00000100:00100000:3.0:1789265486.053196:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:3.0:1789265486.053230:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:9945:x1876180533870848:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789265486.053614:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:9945:x1876180533870848:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 386us (1165us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789265486.053623:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:3.0:1789265486.058967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265486.060050:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533870976 00000100:00100000:2.0:1789265486.060089:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533870976 00010000:00010000:2.0:1789265486.060154:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 28 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265486.060213:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:2.0:1789265486.060226:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:2342:x1876180533870976:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265486.060245:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265486.060254:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 28 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.060270:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 28 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.060326:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:2.0:1789265486.060373:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.060385:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.060395:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265486.060422:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265486.060514:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:2342:x1876180533870976:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 289us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265486.060521:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 85 00010000:00010000:1.0:1789265486.062082:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ec00/0x8e12577ef81902d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f874c expref: 27 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265486.062112:0:9189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9189:1876180553776000:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265486.062146:0:9189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.062157:0:9189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.062163:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265486.062225:0:9189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789265486.062231:0:9189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265486.062259:0:9189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.062289:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063029:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063037:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063070:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063078:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265486.063084:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063093:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063113:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:1.0:1789265486.063116:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265486.063122:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063129:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884000/0x8e12577ef81903b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063144:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063150:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063157:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063162:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265486.063165:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063181:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063191:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff925409ab9b00) 00010000:00010000:1.0:1789265486.063193:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265486.063197:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063202:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef81903be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063260:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef81903b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f878b expref: 27 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.063995:0:9189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f878b expref: 26 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265486.064008:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:1.0:1789265486.064010:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265486.064014:0:9189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:1.0:1789265486.064119:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11597:x1876180533870592:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 18633us (18888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265486.064130:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 232 00010000:00010000:0.0:1789265486.368038:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265487.019235:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265487.019248:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265487.019317:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789265487.019325:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265487.019730:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543700ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553776128:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265487.019958:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265487.024275:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265487.024451:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543700ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1876180553776128:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265487.024642:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533871104 00000100:00100000:3.0:1789265487.024652:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533871104 00000100:00080000:2.0:1789265487.024978:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265487.025100:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 233 00000100:00100000:3.0:1789265487.025114:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11608:x1876180533871104:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265487.025161:0:9387:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265487.025578:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11608:x1876180533871104:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 465us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265487.025586:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 233 00000100:00100000:0.0:1789265487.044928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265487.044988:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533871360 00000100:00100000:0.0:1789265487.045002:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533871360 00000100:00100000:0.0:1789265487.045083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 234 00000100:00100000:0.0:1789265487.045098:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+26:11608:x1876180533871360:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265487.045128:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265487.045158:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef81903cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8792 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.045304:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef81903d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.045325:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef81903d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.045368:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef81903d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265487.045383:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789265487.045570:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef81903cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8792 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.045590:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef81903d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8792 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.048657:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:0.0:1789265487.048664:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265487.048835:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995200, rc 0) 00000100:00100000:0.0:1789265487.049025:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:11608:x1876180533871360:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 3926us (4107us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789265487.049037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 234 00000100:00100000:0.0:1789265487.057836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265487.057937:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533871488 00000100:00100000:3.0:1789265487.057951:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533871488 00000100:00100000:3.0:1789265487.058038:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:3.0:1789265487.058052:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540517e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:2342:x1876180533871488:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265487.058073:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265487.058107:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995200/0x8e12577ef81903d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8792 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.058130:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:3.0:1789265487.058137:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265487.058207:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540517e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:2342:x1876180533871488:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 158us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265487.058226:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:3.0:1789265487.058983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265487.059641:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533871744 00000100:00100000:0.0:1789265487.059654:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533871744 00000100:00100000:0.0:1789265487.059719:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 235 00000100:00100000:0.0:1789265487.059730:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+27:11608:x1876180533871744:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789265487.059848:0:9189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.059869:0:9189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.059883:0:9189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.060319:0:9189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.060354:0:9189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.060362:0:9189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.060378:0:9189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265487.060385:0:9189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.060393:0:9189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.060408:0:9189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:0.0:1789265487.060412:0:9189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265487.060418:0:9189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.060426:0:9189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265487.066609:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265487.066631:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265487.067512:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789265487.067740:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265487.068968:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:11608:x1876180533871744:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 9226us (9974us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789265487.068984:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 235 00000100:00100000:3.0:1789265487.072603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265487.072765:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533872000 00000100:00100000:2.0:1789265487.072779:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533872000 00000100:00100000:2.0:1789265487.072867:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:2.0:1789265487.072880:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+28:11608:x1876180533872000:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265487.073295:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:11608:x1876180533872000:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 416us (707us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789265487.073305:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00000040:00080000:0.0:1789265487.209090:0:12503:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265487.209100:0:12503:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265487.209143:0:12503:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789265487.209149:0:12503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265487.371297:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265487.379906:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533872256 00000100:00100000:2.0:1789265487.379922:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533872256 00000100:00100000:2.0:1789265487.379998:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 236 00000100:00100000:2.0:1789265487.380008:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+29:11621:x1876180533872256:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265487.380036:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265487.380057:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef81903e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8799 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.380160:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81903ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.380174:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81903ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.380185:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81903ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265487.380205:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789265487.380327:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137200/0x8e12577ef81903e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8799 expref: 32 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.380369:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81903ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8799 expref: 31 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.380377:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:2.0:1789265487.380380:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789265487.380383:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137c00, rc 0) 00000100:00100000:2.0:1789265487.380452:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:11621:x1876180533872256:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 445us (9165us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789265487.380459:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 236 00000100:00100000:3.0:1789265487.385297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265487.385486:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533872384 00000100:00100000:0.0:1789265487.385496:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533872384 00000100:00100000:0.0:1789265487.385572:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 237 00000100:00100000:0.0:1789265487.385583:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:11621:x1876180533872384:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:0.0:1789265487.385651:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385669:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385695:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385725:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385732:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385739:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385745:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265487.385750:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385757:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385769:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:0.0:1789265487.385772:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265487.385777:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.385784:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef81903fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265487.385870:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:11621:x1876180533872384:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 289us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265487.386131:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 237 00010000:00010000:1.0:1789265487.392386:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265487.506684:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265487.508421:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533872512 00000100:00100000:1.0:1789265487.508436:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533872512 00000100:00100000:1.0:1789265487.508544:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:1.0:1789265487.508556:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2343:x1876180533872512:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:1.0:1789265487.508573:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265487.508594:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbbd9789/0x8e12577ef8190404 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f87a0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265487.508622:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa6064c, atime: 0x6aa6064c, ctime: 0x6aa6064c, blocks: 0xb 00010000:00010000:1.0:1789265487.508642:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1789265487.508647:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265487.508656:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbd9789/0x8e12577ef8190404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87a0 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.508674:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cbbd9789/0x8e12577ef8190404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87a0 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.508688:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5fc00, rc 0) 00000100:00100000:1.0:1789265487.508759:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533872512:12345-192.168.204.43@tcp:101:cat.0 Request processed in 206us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.508765:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00080000:2.0:1789265487.509238:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265487.522096:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265487.522373:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533872640 00000100:00100000:3.0:1789265487.522384:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533872640 00002000:00100000:3.0:1789265487.522438:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff925401218380 x1876180533872640/t0(0) o3->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:58/0 lens 488/0 e 0 to 0 dl 1789265498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265487.522449:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925401218380 with x1876180533872640 ext(0->4095) 00002000:00010000:3.0:1789265487.522464:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925401218380 00000100:00100000:3.0:1789265487.522503:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:3.0:1789265487.522513:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925401218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533872640:12345-192.168.204.43@tcp:3:cat.0 00000100:00100000:3.0:1789265487.522940:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925401218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533872640:12345-192.168.204.43@tcp:3:cat.0 Request processed in 427us (870us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789265487.522948:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00002000:00100000:3.0:1789265487.522956:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff925401218380 x1876180533872640/t0(0) o3->b9773a89-f93c-421a-9c50-bfa3d5c6f2fa@192.168.204.43@tcp:58/0 lens 488/4536 e 0 to 0 dl 1789265498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265487.522965:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff925401218380 with x1876180533872640 ext(0->4095) 00002000:00010000:3.0:1789265487.522968:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff925401218380 00000100:00100000:2.0:1789265487.774635:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265487.775095:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553776384:0@lo:400:kworker.0 00000100:00100000:2.0:1789265487.775172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265487.775301:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553776256:0@lo:400:kworker.0 00000100:00100000:2.0:1789265487.775364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265487.775661:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553776512:0@lo:400:kworker.0 00000100:00100000:1.0:1789265487.775709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265487.777783:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553776256 00000100:00100000:0.0:1789265487.777799:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553776256 00000100:00100000:0.0:1789265487.777881:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789265487.777892:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553776256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265487.777976:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553776256:12345-0@lo:400:kworker.0 Request processed in 86us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265487.777983:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789265487.778032:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553776768:0@lo:400:kworker.0 00000100:00100000:0.0:1789265487.778067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265487.779782:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553776384 00000100:00100000:3.0:1789265487.779793:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553776384 00000100:00100000:3.0:1789265487.779857:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553776512 00000100:00100000:3.0:1789265487.779860:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553776512 00000100:00100000:3.0:1789265487.779887:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553776768 00000100:00100000:3.0:1789265487.779913:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553776768 00000100:00100000:3.0:1789265487.779934:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265487.779941:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543700ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553776384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265487.779999:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553776256:0@lo:400:kworker.0 00000100:00100000:2.0:1789265487.780025:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553776896:0@lo:400:kworker.0 00000100:00100000:1.0:1789265487.780084:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265487.780092:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553776640:0@lo:400:kworker.0 00000100:00100000:0.0:1789265487.780107:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789265487.780116:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553776512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265487.781452:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543700ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553776384:12345-0@lo:400:kworker.0 Request processed in 1493us (6262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265487.781462:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265487.781490:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789265487.781499:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553776768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265487.781553:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553776768:12345-0@lo:400:kworker.0 Request processed in 56us (3487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265487.781559:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789265487.781609:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553776768:0@lo:400:kworker.0 00000100:00080000:3.0:1789265487.781684:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265487.783672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265487.783745:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553776384:0@lo:400:kworker.0 00000100:00100000:3.0:1789265487.784007:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553776896 00000100:00100000:3.0:1789265487.784014:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553776896 00000100:00100000:3.0:1789265487.784062:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265487.784070:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876180553776896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265487.784127:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876180553776896:12345-0@lo:400:kworker.0 Request processed in 57us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265487.784134:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1789265487.784161:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265487.784185:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553776896:0@lo:400:kworker.0 00000100:00100000:1.0:1789265487.787735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265487.787888:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553776640 00000100:00100000:3.0:1789265487.787898:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553776640 00000100:00100000:3.0:1789265487.787983:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789265487.787995:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553776640:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789265487.788053:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265487.788075:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553776640:12345-0@lo:400:kworker.0 Request processed in 83us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265487.788096:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789265487.788103:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553776640:0@lo:400:kworker.0 00000100:00100000:0.0:1789265487.788614:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553776512:12345-0@lo:400:kworker.0 Request processed in 8497us (12901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265487.788623:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789265487.788719:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553776512:0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.289064:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553777024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265488.289164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265488.289317:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553777024 00000100:00100000:0.0:1789265488.289325:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553777024 00000100:00100000:0.0:1789265488.289392:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789265488.289413:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553777024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265488.289449:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265488.289512:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553777024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265488.289520:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789265488.289876:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9253077f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553777024:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789265488.371814:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789265488.371840:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1789265488.415220:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265489.439640:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265490.336221:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265490.336248:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543bfbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553777152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265490.336368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265490.336478:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553777152 00000100:00100000:0.0:1789265490.336486:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553777152 00000100:00100000:0.0:1789265490.336558:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265490.336569:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9253077f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553777152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265490.336624:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265490.336683:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9253077f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876180553777152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265490.336690:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265490.336743:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543bfbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553777152:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265490.337018:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265490.463981:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265490.551535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265490.551583:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265490.551624:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265490.551646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265490.551682:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265490.551694:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533873024 00000100:00100000:3.0:1789265490.551709:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533873024 00000100:00100000:3.0:1789265490.551790:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533873152 00000100:00100000:3.0:1789265490.551794:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533873152 00000100:00100000:3.0:1789265490.551820:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:3.0:1789265490.551832:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543bfbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533873024:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265490.551867:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533872768 00000100:00100000:1.0:1789265490.551873:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533872768 00000100:00100000:1.0:1789265490.551914:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 300 00000100:00100000:3.0:1789265490.551919:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543bfbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+8:2343:x1876180533873024:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265490.551928:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2343:x1876180533872768:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265490.551932:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:3.0:1789265490.551953:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:3.0:1789265490.551961:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533873152:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265490.551982:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f248648a-8946-448c-8146-af0e3c141002+13:2343:x1876180533872768:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 56us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265490.551990:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 300 00000100:00100000:3.0:1789265490.551995:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2343:x1876180533873152:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265490.552003:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00080000:1.0:1789265490.552023:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265490.552029:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265490.552030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533873280 00000100:00100000:3.0:1789265490.552035:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533873280 00000100:00080000:1.0:1789265490.552055:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265490.552091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533872896 00000100:00100000:3.0:1789265490.552095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533872896 00000100:00100000:3.0:1789265490.552121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 157 00000100:00100000:3.0:1789265490.552128:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2343:x1876180533873280:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265490.552161:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:2343:x1876180533873280:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 33us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265490.552168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 157 00000100:00100000:2.0:1789265490.552190:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 158 00000100:00100000:2.0:1789265490.552204:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:2343:x1876180533872896:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:1.0:1789265490.552215:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265490.552244:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+31:2343:x1876180533872896:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 45us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265490.552253:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 158 00000001:00080000:3.0:1789265490.926328:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1789265490.926385:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1789265490.926393:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1789265490.928810:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:0.0:1789265490.928837:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1789265490.928868:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff925405fc2240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789265490.928875:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543703f200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff925405fc2000 00000020:00080000:0.0:1789265490.928879:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92543703fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92543bb98400 00000020:00080000:0.0:1789265490.928904:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789265490.928937:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789265490.929138:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789265491.486546:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265492.456515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265492.457469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533873408 00000100:00100000:3.0:1789265492.457481:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533873408 00000100:00100000:3.0:1789265492.457555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 238 00000100:00100000:3.0:1789265492.457568:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:11282:x1876180533873408:12345-192.168.204.43@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789265492.457681:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:11282:x1876180533873408:12345-192.168.204.43@tcp:60:lhsmtool_posix.0 Request processed in 117us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.457689:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 238 00000100:00080000:3.0:1789265492.457712:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265492.463213:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265492.464817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533873664 00000100:00100000:0.0:1789265492.464832:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533873664 00000100:00100000:0.0:1789265492.464912:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:0.0:1789265492.464922:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:11282:x1876180533873664:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265492.465272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:11282:x1876180533873664:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 350us (2072us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789265492.465281:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 65 00010000:00010000:2.0:1789265492.511153:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265492.718316:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265492.719109:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533873792 00000100:00100000:1.0:1789265492.719119:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533873792 00000100:00100000:1.0:1789265492.719219:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 239 00000100:00100000:1.0:1789265492.719229:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc11c6fc-2632-4cbd-ac58-de8d52cda298+5:12073:x1876180533873792:12345-192.168.204.43@tcp:101:lsof.0 00010000:00010000:1.0:1789265492.719249:0:9387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265492.719286:0:9387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819040b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f87a7 expref: -99 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.719386:0:9387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef8190412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.719400:0:9387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef8190412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.719413:0:9387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef8190412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265492.719448:0:9387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265492.719451:0:9387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265492.719474:0:9387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef8190412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.719499:0:9387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5f200/0x8e12577ef819040b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87a7 expref: 7 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.719519:0:9387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef8190412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87a7 expref: 6 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.719527:0:9387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:1.0:1789265492.719530:0:9387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265492.719534:0:9387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5ee00, rc 0) 00000100:00100000:1.0:1789265492.719607:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:12073:x1876180533873792:12345-192.168.204.43@tcp:101:lsof.0 Request processed in 379us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.719614:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 239 00000100:00080000:3.0:1789265492.721269:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265492.895966:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553777408:0@lo:400:kworker.0 00000100:00100000:3.0:1789265492.896041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.896105:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553777920:0@lo:400:kworker.0 00000100:00100000:3.0:1789265492.896135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.896166:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265492.896172:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553777280:0@lo:400:kworker.0 00000100:00100000:3.0:1789265492.896200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.896218:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553777792:0@lo:400:kworker.0 00000100:00100000:3.0:1789265492.896241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.896266:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553777536:0@lo:400:kworker.0 00000100:00100000:3.0:1789265492.896290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.896323:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265492.896491:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553777280 00000100:00100000:0.0:1789265492.896499:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553777280 00000100:00100000:0.0:1789265492.896551:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789265492.896560:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553777280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265492.896614:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553777280:12345-0@lo:400:kworker.0 Request processed in 55us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265492.896620:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789265492.896668:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553777280:0@lo:400:kworker.0 00000100:00100000:0.0:1789265492.896739:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553777920 00000100:00100000:0.0:1789265492.896743:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553777920 00000100:00100000:0.0:1789265492.896786:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789265492.896792:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553777920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265492.896829:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553777920:12345-0@lo:400:kworker.0 Request processed in 38us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265492.896835:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789265492.896854:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553777408 00000100:00100000:0.0:1789265492.896858:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553777408 00000100:00100000:0.0:1789265492.896883:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553777792 00000100:00100000:0.0:1789265492.896886:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553777792 00000100:00100000:0.0:1789265492.896904:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553777536 00000100:00100000:0.0:1789265492.896906:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553777536 00000100:00100000:0.0:1789265492.896920:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265492.896925:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553777408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265492.896958:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553777408:12345-0@lo:400:kworker.0 Request processed in 33us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265492.896965:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265492.896977:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789265492.896982:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553777792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265492.897007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876180553777792:12345-0@lo:400:kworker.0 Request processed in 25us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265492.897020:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789265492.897033:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265492.897040:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553777536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265492.897068:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553777536:12345-0@lo:400:kworker.0 Request processed in 29us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265492.897074:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265492.897111:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553777792:0@lo:400:kworker.0 00000100:00100000:0.0:1789265492.897122:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553777408:0@lo:400:kworker.0 00000100:00100000:0.0:1789265492.897132:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789265492.897137:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1789265492.897156:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92540c33bb80, transno 4294967310 00000100:00100000:0.0:1789265492.897168:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553777920:0@lo:400:kworker.0 00000100:00080000:2.0:1789265492.897524:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265492.897529:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265492.899076:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553777664:0@lo:400:kworker.0 00000100:00100000:3.0:1789265492.899167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.899243:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553777536:0@lo:400:kworker.0 00000100:00100000:2.0:1789265492.900760:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553777664 00000100:00100000:2.0:1789265492.900774:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553777664 00000100:00100000:2.0:1789265492.900877:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789265492.900890:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553777664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265492.900985:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553777664:12345-0@lo:400:kworker.0 Request processed in 99us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.900992:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265492.901138:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789265492.901160:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff925402c48e00, transno 4294967322 00000004:00080000:1.0:1789265492.901178:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1789265492.901201:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553777664:0@lo:400:kworker.0 00000100:00080000:3.0:1789265492.902086:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265493.407897:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265493.407924:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925436e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553778048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265493.408008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265493.408306:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553778048 00000100:00100000:1.0:1789265493.408315:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553778048 00000100:00100000:1.0:1789265493.408398:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265493.408409:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553778048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265493.408446:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265493.408513:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553778048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265493.408519:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789265493.409169:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925436e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553778048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265493.534637:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265494.561134:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265495.262579:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265495.262588:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265495.262893:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789265495.262900:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265495.455598:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265495.455622:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553778176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265495.455719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265495.455877:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553778176 00000100:00100000:0.0:1789265495.455886:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553778176 00000100:00100000:0.0:1789265495.455959:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789265495.455969:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553778176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265495.456003:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265495.456048:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553778176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265495.456055:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265495.456135:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553778176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265495.456229:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265495.586268:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265495.674057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265495.674147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265495.674176:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265495.674194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265495.674216:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533874432 00000100:00100000:3.0:1789265495.674221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265495.674227:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533874432 00000100:00100000:2.0:1789265495.674299:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533874048 00000100:00100000:2.0:1789265495.674303:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533874048 00000100:00100000:2.0:1789265495.674326:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 162 00000100:00080000:3.0:1789265495.674350:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265495.674353:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2345:x1876180533874432:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265495.674429:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2345:x1876180533874432:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265495.674437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 162 00000100:00100000:2.0:1789265495.674455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 163 00000100:00100000:2.0:1789265495.674462:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:2345:x1876180533874048:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265495.674492:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:2345:x1876180533874048:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265495.674498:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 163 00000100:00100000:0.0:1789265495.674629:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533873920 00000100:00100000:0.0:1789265495.674634:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533873920 00000100:00100000:0.0:1789265495.674730:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 302 00000100:00100000:0.0:1789265495.674807:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533873920:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265495.675498:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f248648a-8946-448c-8146-af0e3c141002+13:2345:x1876180533873920:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 756us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265495.675507:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 302 00000100:00100000:0.0:1789265495.675544:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533874176 00000100:00100000:0.0:1789265495.675548:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533874176 00000100:00100000:0.0:1789265495.675584:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533874304 00000100:00100000:0.0:1789265495.675587:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533874304 00000100:00100000:0.0:1789265495.675610:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:0.0:1789265495.675616:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533874176:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265495.675648:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2345:x1876180533874176:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 32us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265495.675655:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:0.0:1789265495.675678:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:0.0:1789265495.675684:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533874304:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265495.675711:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2345:x1876180533874304:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 26us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265495.675717:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00080000:0.0:1789265495.675755:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265495.675758:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1789265495.685748:0:12703:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:11:33 (1789265493) 00000001:00080000:3.0:1789265496.018967:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1789265496.018983:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789265496.019046:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789265496.019064:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789265496.613236:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265497.632511:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265498.015225:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553778304:0@lo:400:kworker.0 00000100:00100000:3.0:1789265498.015305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265498.015745:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553778560:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.015759:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553778432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.015796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265498.015867:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265498.015874:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553778688:0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.015903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265498.015962:0:9387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553778560 00000100:00100000:0.0:1789265498.015970:0:9387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553778560 00000100:00100000:0.0:1789265498.016036:0:9387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789265498.016047:0:9387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553778560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265498.017505:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553778816:0@lo:400:kworker.0 00000100:00100000:3.0:1789265498.017552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.018346:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553778688 00000100:00100000:2.0:1789265498.018356:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553778688 00000100:00100000:2.0:1789265498.018419:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265498.018437:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925407251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553778688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.018507:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925407251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553778688:12345-0@lo:400:kworker.0 Request processed in 79us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265498.018515:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265498.018553:0:9189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553778816 00000100:00100000:2.0:1789265498.018557:0:9189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553778816 00000100:00100000:2.0:1789265498.018581:0:9189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789265498.018587:0:9189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553778816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.018638:0:9189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876180553778816:12345-0@lo:400:kworker.0 Request processed in 50us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265498.018644:0:9189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789265498.018684:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543775e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553778688:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.018714:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876180553778816:0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.018939:0:9387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553778560:12345-0@lo:400:kworker.0 Request processed in 2894us (3142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.018947:0:9387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1789265498.018970:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265498.018975:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265498.018988:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553778304 00000100:00100000:0.0:1789265498.018992:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553778304 00000100:00100000:0.0:1789265498.019033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789265498.019040:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553778304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.020915:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553778560:0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.021075:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553778304:12345-0@lo:400:kworker.0 Request processed in 2023us (5759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.021086:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789265498.021153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265498.021271:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553778944:0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.021360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265498.021394:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553778944 00000100:00100000:0.0:1789265498.021407:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553778944 00000100:00100000:0.0:1789265498.021463:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265498.021472:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553778944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.021519:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553778944:12345-0@lo:400:kworker.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.021525:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1789265498.021540:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265498.021557:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553778944:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.024688:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553778304:0@lo:400:kworker.0 00000100:00100000:3.0:1789265498.025247:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553778432 00000100:00100000:3.0:1789265498.025256:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553778432 00000100:00100000:3.0:1789265498.026689:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789265498.026709:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553778432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265498.026820:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553778432:12345-0@lo:400:kworker.0 Request processed in 119us (5665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265498.026842:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789265498.026943:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553778432:0@lo:400:kworker.0 00000100:00100000:3.0:1789265498.526856:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265498.526882:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553779072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265498.526955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.527834:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553779072 00000100:00100000:2.0:1789265498.527846:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553779072 00000100:00100000:2.0:1789265498.527914:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789265498.527926:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544188bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553779072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265498.527988:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265498.528072:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544188bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553779072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265498.528080:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265498.530079:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553779072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265498.655552:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265499.298845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265499.298922:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533874688 00000100:00100000:0.0:1789265499.298935:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533874688 00000100:00100000:0.0:1789265499.299026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:0.0:1789265499.299038:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+18:12294:x1876180533874688:12345-192.168.204.43@tcp:35:umount.0 00000100:00100000:0.0:1789265499.299478:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:12294:x1876180533874688:12345-192.168.204.43@tcp:35:umount.0 Request processed in 441us (641us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789265499.299487:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00080000:1.0:1789265499.301144:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265499.303659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265499.303773:0:12056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533874944 00000100:00100000:2.0:1789265499.303783:0:12056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533874944 00000100:00100000:2.0:1789265499.303842:0:12056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:2.0:1789265499.303852:0:12056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+19:12294:x1876180533874944:12345-192.168.204.43@tcp:35:umount.0 00000100:00100000:2.0:1789265499.304252:0:12056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:12294:x1876180533874944:12345-192.168.204.43@tcp:35:umount.0 Request processed in 400us (601us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789265499.304260:0:12056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:3.0:1789265499.306250:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265499.308711:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533875200 00000100:00100000:0.0:1789265499.308731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533875200 00000100:00100000:0.0:1789265499.308824:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:0.0:1789265499.308835:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a5be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+20:12294:x1876180533875200:12345-192.168.204.43@tcp:35:umount.0 00000100:00100000:0.0:1789265499.309105:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a5be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:12294:x1876180533875200:12345-192.168.204.43@tcp:35:umount.0 Request processed in 271us (2865us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789265499.309120:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:0.0:1789265499.315083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265499.315256:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533875456 00000100:00100000:3.0:1789265499.315266:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533875456 00000100:00100000:3.0:1789265499.315371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:3.0:1789265499.315385:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+21:12294:x1876180533875456:12345-192.168.204.43@tcp:35:umount.0 00000100:00100000:3.0:1789265499.315779:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:12294:x1876180533875456:12345-192.168.204.43@tcp:35:umount.0 Request processed in 396us (703us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789265499.315788:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:3.0:1789265499.324927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265499.324970:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265499.325003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265499.325082:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533875712 00000100:00100000:0.0:1789265499.325120:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533875712 00000100:00100000:0.0:1789265499.325189:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533875584 00000100:00100000:0.0:1789265499.325193:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533875584 00000100:00100000:0.0:1789265499.325207:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533875840 00000100:00100000:0.0:1789265499.325210:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533875840 00000100:00100000:0.0:1789265499.325226:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:0.0:1789265499.325235:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+15:2344:x1876180533875712:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265499.325252:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265499.325274:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136600/0x8e12577ef818f3f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f82fa expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265499.325292:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265499.325394:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+14:2344:x1876180533875712:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 160us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265499.325403:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:0.0:1789265499.325423:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:0.0:1789265499.325430:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+13:2342:x1876180533875584:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265499.325439:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265499.325448:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207da00/0x8e12577ef818f48a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8332 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265499.325458:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265499.325475:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+12:2342:x1876180533875584:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 46us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265499.325482:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:0.0:1789265499.325495:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1789265499.325501:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+11:2343:x1876180533875840:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265499.325517:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265499.325526:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441885600/0x8e12577ef818f69e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83fd expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265499.325534:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265499.325552:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f248648a-8946-448c-8146-af0e3c141002+10:2343:x1876180533875840:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 52us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265499.325558:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1789265499.326325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265499.326461:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533875968 00000100:00100000:3.0:1789265499.326467:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533875968 00000100:00100000:3.0:1789265499.326519:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:3.0:1789265499.326528:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2341:x1876180533875968:12345-192.168.204.43@tcp:9:umount.0 00000020:00000080:3.0:1789265499.326554:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f762 00000100:00080000:3.0:1789265499.326564:0:6680:0:(import.c:65:import_set_state_nolock()) ffff925403fca000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265499.326617:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789265499.326910:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+2:2341:x1876180533875968:12345-192.168.204.43@tcp:9:umount.0 Request processed in 383us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265499.326932:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 72 00010000:00010000:3.0:1789265499.326952:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265499.327370:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265499.343622:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265499.343812:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533876352 00000100:00100000:2.0:1789265499.343824:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533876352 00000100:00100000:2.0:1789265499.343905:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:2.0:1789265499.343917:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2341:x1876180533876352:12345-192.168.204.43@tcp:9:umount.0 00000020:00000080:2.0:1789265499.343950:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f9ca 00000020:00010000:2.0:1789265499.343958:0:6678:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92540a450800: total 0 00000100:00080000:2.0:1789265499.343963:0:6678:0:(import.c:65:import_set_state_nolock()) ffff92540a457000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265499.344011:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789265499.344304:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+5:2341:x1876180533876352:12345-192.168.204.43@tcp:9:umount.0 Request processed in 388us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265499.344312:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 73 00000020:00010000:3.0:1789265499.344617:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92540a450800: total 0 00010000:00010000:3.0:1789265499.344663:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92540a450800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789265499.344724:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef818fd66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85d2 expref: 4 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265499.344761:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbbd9789/0x8e12577ef8190404 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87a0 expref: 3 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265499.344778:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92540a450800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789265499.344790:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265499.344793:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265499.344795:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265499.345080:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265499.360317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265499.360625:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533877376 00000100:00100000:2.0:1789265499.360637:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533877376 00000100:00100000:2.0:1789265499.360713:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 240 00000100:00100000:2.0:1789265499.360723:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+22:2341:x1876180533877376:12345-192.168.204.43@tcp:39:umount.0 00000020:00000080:2.0:1789265499.360758:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f3fe 00000020:00010000:2.0:1789265499.360777:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9254377ee800: total 0 00000100:00080000:2.0:1789265499.360783:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9254377ec000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265499.360813:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1789265499.361234:0:11652:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9254377ee800: total 0 00010000:00010000:1.0:1789265499.361280:0:11652:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9254377ee800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789265499.361324:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff925409ab9400) 00010000:00010000:1.0:1789265499.361328:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265499.361356:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885a00/0x8e12577ef818f6e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8412 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361385:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265499.361388:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265499.361422:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e600/0x8e12577ef818fd27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85bd expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361441:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:1.0:1789265499.361443:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265499.361447:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81903c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f878b expref: 19 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361459:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:1.0:1789265499.361461:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265499.361464:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef818fdc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85ee expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361474:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:1.0:1789265499.361476:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265499.361480:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403137c00/0x8e12577ef81903ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8799 expref: 17 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361490:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265499.361492:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265499.361495:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef818fa25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f84f9 expref: 16 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361507:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92540cd7ac00) 00010000:00010000:1.0:1789265499.361509:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265499.361512:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5fe00/0x8e12577ef818f6c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f840b expref: 15 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361528:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265499.361536:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265499.361541:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884600/0x8e12577ef818fd51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85cb expref: 14 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361556:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:1.0:1789265499.361559:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265499.361563:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81900c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f86c7 expref: 13 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361575:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff925409ab9700) 00010000:00010000:1.0:1789265499.361578:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265499.361581:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81902e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8753 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361606:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92542b074100) 00010000:00010000:1.0:1789265499.361608:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265499.361612:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994400/0x8e12577ef818fde4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f85f5 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361625:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92540ccf3900) 00010000:00010000:1.0:1789265499.361628:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265499.361631:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5e800/0x8e12577ef818fc47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8585 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361657:0:11652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92540ccf3f00) 00010000:00010000:1.0:1789265499.361660:0:11652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265499.361664:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925403136800/0x8e12577ef818f738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8427 expref: 9 pid: 9189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265499.361690:0:11652:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9254377ee800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789265499.361703:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265499.361705:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265499.361708:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265499.364361:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9773a89-f93c-421a-9c50-bfa3d5c6f2fa+7:2341:x1876180533877376:12345-192.168.204.43@tcp:39:umount.0 Request processed in 3625us (4051us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789265499.364376:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 240 00010000:00010000:2.0:1789265499.680675:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265500.575606:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553779200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265500.575681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265500.576054:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553779200 00000100:00100000:1.0:1789265500.576061:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553779200 00000100:00100000:1.0:1789265500.576137:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265500.576148:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553779200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265500.576186:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789265500.576432:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265500.580434:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553779200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4267us (4731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265500.580451:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265500.582163:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553779200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265500.684520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265500.684576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265500.684615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265500.684837:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533877504 00000100:00100000:3.0:1789265500.684849:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533877504 00000100:00100000:3.0:1789265500.684910:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533877760 00000100:00100000:3.0:1789265500.684913:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533877760 00000100:00100000:3.0:1789265500.684925:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533877632 00000100:00100000:3.0:1789265500.684927:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533877632 00000100:00100000:3.0:1789265500.684942:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1789265500.684952:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f248648a-8946-448c-8146-af0e3c141002+12:2342:x1876180533877504:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265500.684967:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265500.685025:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136a00/0x8e12577ef818f4d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8347 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265500.685046:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265500.685100:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f248648a-8946-448c-8146-af0e3c141002+11:2342:x1876180533877504:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 150us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265500.685108:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1789265500.685127:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:3.0:1789265500.685134:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925402c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f248648a-8946-448c-8146-af0e3c141002+10:2342:x1876180533877760:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265500.685142:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265500.685152:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136400/0x8e12577ef818f697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f83f6 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265500.685161:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265500.685185:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925402c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f248648a-8946-448c-8146-af0e3c141002+9:2342:x1876180533877760:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 52us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265500.685191:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:3.0:1789265500.685203:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:3.0:1789265500.685209:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f248648a-8946-448c-8146-af0e3c141002+8:2342:x1876180533877632:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265500.685217:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265500.685226:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207c600/0x8e12577ef818f4d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8371 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265500.685235:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265500.685254:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f248648a-8946-448c-8146-af0e3c141002+7:2342:x1876180533877632:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 44us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265500.685260:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:1.0:1789265500.695470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265500.695535:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533878016 00000100:00100000:0.0:1789265500.695548:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533878016 00000100:00100000:0.0:1789265500.695637:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 241 00000100:00100000:0.0:1789265500.695650:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+6:2341:x1876180533878016:12345-192.168.204.43@tcp:39:umount.0 00000100:00080000:1.0:1789265500.695685:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1789265500.695692:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f4e5 00000020:00010000:0.0:1789265500.695701:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff925403516800: total 0 00000100:00080000:0.0:1789265500.695707:0:5833:0:(import.c:65:import_set_state_nolock()) ffff925403512000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265500.695743:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1789265500.695759:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff925403516800: total 0 00010000:00010000:3.0:1789265500.695815:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff925403516800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789265500.695853:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92542b074f00) 00010000:00010000:3.0:1789265500.695856:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265500.695865:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92543bc5ee00/0x8e12577ef8190412 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87a7 expref: 6 pid: 9387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265500.695892:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff925403516800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789265500.695907:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265500.695910:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265500.695912:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265500.695987:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc11c6fc-2632-4cbd-ac58-de8d52cda298+3:2341:x1876180533878016:12345-192.168.204.43@tcp:39:umount.0 Request processed in 339us (523us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789265500.695995:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 241 00010000:00010000:3.0:1789265500.702457:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265500.719145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265500.720780:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533878272 00000100:00100000:2.0:1789265500.720803:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533878272 00000100:00100000:2.0:1789265500.720867:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 304 00000100:00100000:2.0:1789265500.720876:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+7:2341:x1876180533878272:12345-192.168.204.43@tcp:251:umount.0 00000020:00000080:2.0:1789265500.720935:0:5825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f3db 00000020:00010000:2.0:1789265500.720942:0:5825:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9254377e9800: total 0 00000100:00080000:2.0:1789265500.720946:0:5825:0:(import.c:65:import_set_state_nolock()) ffff925441866800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789265500.721091:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f248648a-8946-448c-8146-af0e3c141002+3:2341:x1876180533878272:12345-192.168.204.43@tcp:251:umount.0 Request processed in 215us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265500.721099:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 304 00000020:00010000:1.0:1789265500.722774:0:11652:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9254377e9800: total 0 00010000:00010000:1.0:1789265500.722855:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265500.722905:0:11652:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9254377e9800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789265500.722941:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207c800/0x8e12577ef818f491 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8339 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265500.722959:0:11652:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9254377e9800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789265500.722968:0:11652:0:(genops.c:885:class_export_put()) final put ffff9254377e9800/f248648a-8946-448c-8146-af0e3c141002 00010000:00010000:1.0:1789265500.723171:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265500.723173:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265500.723175:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265500.723200:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9254377e9800/f248648a-8946-448c-8146-af0e3c141002 for MGS 00000020:00000080:0.0:1789265500.723310:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925441866800 for MGS 00000001:00100000:1.0:1789265501.166160:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc11c6fc-2632-4cbd-ac58-de8d52cda298 00000001:00080000:1.0:1789265501.166178:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789265501.166194:0:5855:0:(genops.c:885:class_export_put()) final put ffff925403516800/cc11c6fc-2632-4cbd-ac58-de8d52cda298 00000001:00080000:1.0:1789265501.166215:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1789265501.166226:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000001:00080000:1.0:1789265501.166230:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1789265501.166237:0:5855:0:(genops.c:885:class_export_put()) final put ffff9254377ee800/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:1.0:1789265501.166257:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925403516800/cc11c6fc-2632-4cbd-ac58-de8d52cda298 for lustre-MDT0000 00000020:00000080:1.0:1789265501.166354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9254377ee800/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa for lustre-MDT0000 00000020:00000080:1.0:1789265501.166392:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925403512000 for lustre-MDT0000 00000020:00000080:1.0:1789265501.166397:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9254377ec000 for lustre-MDT0000 00000001:00100000:0.0:1789265501.169764:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:0.0:1789265501.169785:0:6704:0:(genops.c:885:class_export_put()) final put ffff92540a450800/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:0.0:1789265501.169818:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92540a450800/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa for lustre-OST0000 00000020:00000080:0.0:1789265501.169865:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92540a457000 for lustre-OST0000 00010000:00010000:3.0:1789265501.727476:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265502.354589:0:12902:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789265502.372395:0:12902:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789265502.372452:0:12902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.372909:0:12902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.372918:0:12902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.373051:0:12902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.373083:0:12902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789265502.373089:0:12902:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1789265502.373100:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265502.373108:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.373116:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207dc00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265502.373120:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265502.373122:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265502.373127:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789265502.373129:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265502.373132:0:12902:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:3.0:1789265502.373136:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265502.373143:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265502.373146:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789265502.373148:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1789265502.373156:0:12902:0:(import.c:65:import_set_state_nolock()) ffff92543bac3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789265502.373188:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.373194:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265502.373233:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.373242:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92544207dc00/0x8e12577ef818f460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f467 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265502.373551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553779456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265502.373552:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265502.373554:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265502.373556:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265502.373564:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553779328:0@lo:39:umount.0 00000100:00100000:3.0:1789265502.373622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265502.373622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.373955:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553779328 00000100:00100000:3.0:1789265502.373964:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553779328 00000100:00100000:3.0:1789265502.374020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789265502.374037:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876180553779328:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789265502.374062:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f1f8 00000100:00080000:3.0:1789265502.374071:0:5834:0:(import.c:65:import_set_state_nolock()) ffff925441bec000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789265502.374135:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265502.374145:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1876180553779328:12345-0@lo:39:umount.0 Request processed in 111us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.374153:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1789265502.374163:0:5834:0:(genops.c:885:class_export_put()) final put ffff925441be9000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1789265502.374198:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553779456 00000100:00100000:3.0:1789265502.374202:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553779456 00000100:00100000:3.0:1789265502.374236:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265502.374244:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540517d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3306:x1876180553779456:12345-0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789265502.374260:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441be9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789265502.374322:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925441bec000 for lustre-MDT0000 00010000:00010000:3.0:1789265502.374356:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265502.374372:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9254013c2200/0x8e12577ef818f467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f460 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.374386:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265502.374416:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540517d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:3306:x1876180553779456:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.374423:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265502.374567:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553779456:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789265502.374618:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543bac3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789265502.374635:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553779328:0@lo:39:umount.0 00000100:00080000:0.0:1789265502.374708:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265502.374711:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265502.374715:0:12902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789265502.376660:0:12902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376678:0:12902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376685:0:12902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376692:0:12902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376718:0:12902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265502.376724:0:12902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376730:0:12902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376735:0:12902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376754:0:12902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376770:0:12902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265502.376777:0:12902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376783:0:12902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376789:0:12902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376795:0:12902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376805:0:12902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789265502.376810:0:12902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376816:0:12902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376821:0:12902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376825:0:12902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.376848:0:12902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789265502.376859:0:11652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789265502.376864:0:11651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265502.376868:0:11652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.376870:0:11651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.376879:0:11651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9254027de400 already unused, calling callback (ffffffffc1bb9c20) 00010000:00010000:0.0:1789265502.376879:0:11652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92544207d600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265502.376884:0:11651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265502.376884:0:11652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.376895:0:11651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.376895:0:11652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265502.376905:0:11651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265502.376905:0:11652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265502.376912:0:11651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265502.376912:0:11652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265502.376915:0:11651:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789265502.376915:0:11652:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789265502.376918:0:11651:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:0.0:1789265502.376918:0:11652:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1789265502.376957:0:11652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.376963:0:11652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265502.376989:0:11652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.376997:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92544207d600/0x8e12577ef818f46e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f475 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377012:0:11652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265502.377023:0:11652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377030:0:11652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:0.0:1789265502.377034:0:11652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377041:0:11652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265502.377048:0:11652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265502.377053:0:11652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789265502.377056:0:11652:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789265502.377057:0:11652:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789265502.377069:0:11652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.377070:0:11651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377076:0:11652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265502.377087:0:11651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265502.377098:0:11651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377098:0:11652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.377106:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254027de400/0x8e12577ef818f395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f39c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377106:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925441994800/0x8e12577ef818f689 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f690 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377116:0:11652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265502.377119:0:11652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.377120:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265502.377121:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265502.377123:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265502.377124:0:11652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030200 already unused, calling callback (ffffffffc1bb9c20) 00010000:00010000:3.0:1789265502.377129:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789265502.377133:0:11652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377139:0:11652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265502.377145:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553779712:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789265502.377145:0:11652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265502.377150:0:11652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265502.377152:0:11652:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789265502.377153:0:11652:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789265502.377165:0:11652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377170:0:11652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265502.377175:0:11652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377189:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030200/0x8e12577ef818f149 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f150 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377199:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265502.377201:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265502.377202:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265502.377209:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265502.377217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265502.377217:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553779584:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1789265502.377253:0:12902:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:3.0:1789265502.377264:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265502.377273:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553779840:0@lo:103:ldlm_bl.0 00000020:01000004:1.0:1789265502.377287:0:12902:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789265502.377292:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789265502.377297:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265502.377303:0:12902:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789265502.377308:0:12902:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff925441447000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1789265502.377309:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553779712 00000100:00100000:3.0:1789265502.377317:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553779712 00000020:00080000:1.0:1789265502.377317:0:12902:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9253050f9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265502.377325:0:12902:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff925402d50000) has exports, disconnecting them 00000100:00100000:0.0:1789265502.377328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789265502.377361:0:12902:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff925441447000), last request at 1789265498 00000020:00000080:1.0:1789265502.377369:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f35d 00000100:00080000:1.0:1789265502.377391:0:12902:0:(import.c:65:import_set_state_nolock()) ffff925441442000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789265502.377391:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265502.377400:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553779968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265502.377423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789265502.377445:0:12902:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff925441447000): rc 0 00000020:00000080:1.0:1789265502.377448:0:12902:0:(genops.c:885:class_export_put()) final put ffff925441447000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789265502.377465:0:12902:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9253050f9000), last request at 1789265498 00000020:00000080:1.0:1789265502.377468:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f292 00000100:00080000:1.0:1789265502.377475:0:12902:0:(import.c:65:import_set_state_nolock()) ffff9253050fb800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789265502.377485:0:12902:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9253050f9000): rc 0 00000020:00000080:1.0:1789265502.377487:0:12902:0:(genops.c:885:class_export_put()) final put ffff9253050f9000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789265502.377493:0:12902:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9e5bc1c83ae0 00000100:00080000:1.0:1789265502.377513:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789265502.377516:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1789265502.377542:0:12902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265502.377599:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553779584 00000100:00100000:0.0:1789265502.377604:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553779584 00000100:00080000:1.0:1789265502.377606:0:12902:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789265502.377623:0:12902:0:(import.c:65:import_set_state_nolock()) ffff92543b66f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789265502.377638:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789265502.377641:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000100:00100000:0.0:1789265502.377644:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553779968 00000100:00100000:0.0:1789265502.377648:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553779968 00000004:00080000:1.0:1789265502.377660:0:12902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265502.377667:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265502.377675:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+20:3307:x1876180553779584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265502.377687:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265502.377703:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441885200/0x8e12577ef818f475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f46e expref: 20 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377713:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1789265502.377743:0:12902:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789265502.377748:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553779584:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.377752:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265502.377756:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789265502.377758:0:12902:0:(import.c:65:import_set_state_nolock()) ffff925441447800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789265502.377760:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+19:3307:x1876180553779968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265502.377771:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789265502.377772:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265502.377778:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+18:3305:x1876180553779712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265502.377780:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400031a00/0x8e12577ef818f150 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f149 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.377785:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265502.377794:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400030600/0x8e12577ef818f39c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f395 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.377797:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:1.0:1789265502.377804:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff925402d50000) has no exports 00010000:00010000:0.0:1789265502.377804:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265502.377824:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925436e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:3307:x1876180553779968:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265502.377826:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+16:3305:x1876180553779712:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.377831:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265502.377842:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265502.377860:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553780096:0@lo:9:umount.0 00000100:00100000:3.0:1789265502.377892:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.377914:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553780224:0@lo:9:umount.0 00000020:00000080:2.0:1789265502.377914:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925441447000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1789265502.377965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789265502.377971:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9253050f9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1789265502.378002:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553779712:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789265502.378007:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925441442000 for lustre-MDT0000 00000020:00000080:2.0:1789265502.378015:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9253050fb800 for lustre-MDT0000 00000100:00100000:3.0:1789265502.378029:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265502.378046:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553779968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265502.378057:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553779584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265502.378065:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553780096 00000100:00100000:3.0:1789265502.378069:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553780096 00000100:00100000:3.0:1789265502.378113:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553780224 00000100:00100000:3.0:1789265502.378117:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553780224 00000100:00100000:2.0:1789265502.379257:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265502.379351:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265502.379369:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876180553780224:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789265502.379398:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f3cd 00000100:00080000:3.0:1789265502.379408:0:6680:0:(import.c:65:import_set_state_nolock()) ffff92543b66a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265502.379449:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789265502.379684:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1876180553780224:12345-0@lo:9:umount.0 Request processed in 323us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.379692:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789265502.379719:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265502.379722:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265502.379731:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265502.379738:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265502.379745:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265502.379756:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553779840 00000100:00100000:3.0:1789265502.379763:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553779840 00000100:00100000:3.0:1789265502.379798:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265502.379806:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+15:3305:x1876180553779840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265502.379816:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265502.379833:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92543bc5f800/0x8e12577ef818f690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f689 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265502.379868:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265502.379901:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c534bc8-3a63-4f3a-b547-3e911eb5da8a+14:3305:x1876180553779840:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.379908:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265502.379949:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3305:1876180553779840:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789265502.379969:0:3303:0:(import.c:65:import_set_state_nolock()) ffff925441447800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789265502.379984:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789265502.379986:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265502.379989:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553780224:0@lo:9:umount.0 00000100:00100000:2.0:1789265502.380101:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876180553780096:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789265502.380119:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f2df 00000100:00080000:2.0:1789265502.380125:0:6678:0:(import.c:65:import_set_state_nolock()) ffff925304b53000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265502.380313:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:1.0:1789265502.380398:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265502.380628:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1876180553780096:12345-0@lo:9:umount.0 Request processed in 533us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.380637:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789265502.380654:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b66f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789265502.380672:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789265502.380675:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265502.380680:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553780096:0@lo:9:umount.0 00000020:00080000:0.0:1789265502.391182:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff925402d50000) has no exports 00000020:00000080:0.0:1789265502.457147:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f1a4 00000020:00000080:0.0:1789265502.457165:0:12902:0:(genops.c:885:class_export_put()) final put ffff92543b47f800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789265502.457241:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789265502.457380:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265502.457390:0:12902:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789265502.457395:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff92543d3b8000) has no exports 00000020:00000080:3.0:1789265502.457864:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f19d 00000020:00000080:3.0:1789265502.457871:0:12902:0:(genops.c:885:class_export_put()) final put ffff92543d3ad000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789265502.458003:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b47f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789265502.458116:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92543d3ad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265502.458184:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265502.458192:0:12902:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789265502.458195:0:12902:0:(genops.c:885:class_export_put()) final put ffff92543d3ad800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789265502.458198:0:12902:0:(genops.c:844:class_export_destroy()) destroying export ffff92543d3ad800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789265502.458205:0:12902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1789265502.458556:0:12902:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92540850aba0 - data ffff92530784e288/ffff925304b6b000 00000020:01000000:3.0:1789265502.458696:0:12902:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9254080d3f00 - data ffff92540cb30e58/ffff92543d4a5000 00000001:00000004:3.0:1789265502.470018:0:12902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1789265502.539979:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789265502.539988:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789265502.540006:0:12902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265502.540008:0:12902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789265502.540748:0:7151:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789265502.540753:0:7151:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1789265502.540766:0:7151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789265502.542460:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789265502.542466:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789265502.542479:0:12902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265502.542482:0:12902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789265502.542866:0:8043:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789265502.542871:0:8043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789265502.542880:0:8043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789265502.646673:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f16c 00000020:00000080:3.0:1789265502.646691:0:12902:0:(genops.c:885:class_export_put()) final put ffff9254305bf000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789265502.647680:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f181 00000020:00000080:3.0:1789265502.647692:0:12902:0:(genops.c:885:class_export_put()) final put ffff925441bed800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789265502.647699:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789265502.647724:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265502.647736:0:12902:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789265502.647741:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff925402d519b8) has no exports 00000020:00000080:1.0:1789265502.647975:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9254305bf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789265502.647989:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441bed800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1789265502.648154:0:12902:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789265502.648163:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f3bf 00000020:00000080:3.0:1789265502.648169:0:12902:0:(genops.c:885:class_export_put()) final put ffff92543b66d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789265502.648215:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789265502.648221:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265502.648229:0:12902:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789265502.648232:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff925403ed19b8) has no exports 00000020:00000080:3.0:1789265502.648240:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f3b8 00000020:00000080:3.0:1789265502.648245:0:12902:0:(genops.c:885:class_export_put()) final put ffff925441444000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789265502.648586:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b66d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789265502.648898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441444000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789265502.649223:0:12902:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789265502.649228:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789265502.649234:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789265502.649241:0:12902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265502.649243:0:12902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265502.649326:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265502.649364:0:12902:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265502.649373:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f2d8 00000020:00000080:3.0:1789265502.649380:0:12902:0:(genops.c:885:class_export_put()) final put ffff9254093f8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265502.649735:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925441447800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789265502.649744:0:36:0:(genops.c:885:class_export_put()) final put ffff925441441000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265502.649746:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441441000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789265502.649753:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789265502.649940:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789265502.649945:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265502.649952:0:12902:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789265502.649956:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9254373c4d28) has no exports 00000020:00000080:3.0:1789265502.649962:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f2d1 00000020:00000080:3.0:1789265502.649967:0:12902:0:(genops.c:885:class_export_put()) final put ffff92543b668800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789265502.650429:0:12902:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789265502.650434:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789265502.650438:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1789265502.650442:0:12902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265502.650444:0:12902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265502.650488:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265502.650493:0:12902:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265502.650539:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265502.650543:0:12902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265502.650547:0:12902:0:(genops.c:885:class_export_put()) final put ffff9254305bb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789265502.650550:0:12902:0:(genops.c:844:class_export_destroy()) destroying export ffff9254305bb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789265502.650559:0:12902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265502.650735:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f188 00000020:00000080:3.0:1789265502.650741:0:12902:0:(genops.c:885:class_export_put()) final put ffff925441bee800/lustre-MDD0000_UUID 00000020:01000000:3.0:1789265502.650745:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789265502.650749:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265502.650752:0:12902:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789265502.650755:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff925402d53370) has no exports 00000020:00000080:3.0:1789265502.650778:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265502.650782:0:12902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789265502.650786:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f18f 00000020:00000080:3.0:1789265502.650789:0:12902:0:(genops.c:885:class_export_put()) final put ffff925441be9800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789265502.650800:0:12902:0:(tgt_mount.c:187:server_put_mount()) put mount ffff925409ebd800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789265502.650803:0:12902:0:(obd_mount.c:710:lustre_put_lsi()) put ffff925409ebd800 3 00000020:01000004:3.0:1789265502.650807:0:12902:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff925409ebd800 from lustre-MDT0000 00000020:00000080:3.0:1789265502.650905:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265502.650910:0:12902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789265502.650914:0:12902:0:(genops.c:885:class_export_put()) final put ffff9254305b8800/lustre-MDT0000_UUID 00000020:00000080:3.0:1789265502.650916:0:12902:0:(genops.c:844:class_export_destroy()) destroying export ffff9254305b8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789265502.650930:0:12902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789265502.650956:0:12902:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789265502.650961:0:12902:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789265502.650964:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789265502.650967:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265502.650970:0:12902:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789265502.650978:0:12902:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff92540a4f3000 1c534bc8-3a63-4f3a-b547-3e911eb5da8a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265502.650984:0:12902:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff925403ed3370) has exports, disconnecting them 00000020:00080000:3.0:1789265502.650995:0:12902:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff92540a4f3000), last request at 1789265274 00000020:00000080:3.0:1789265502.651012:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f126 00000020:00010000:3.0:1789265502.651017:0:12902:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92540a4f3000: total 4 00000100:00080000:3.0:1789265502.651022:0:12902:0:(import.c:65:import_set_state_nolock()) ffff92540a4f6800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789265502.651091:0:12902:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92540a4f3000): rc 0 00000020:00080000:3.0:1789265502.651096:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff925403ed3370) has no exports 00000100:00100000:3.0:1789265502.651166:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff925403992200:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1789265502.651304:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9254090bce00:5828] 2 exiting: rc = 0 00000020:00000080:0.0:1789265502.651424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9254093f8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789265502.651433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b668800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789265502.651439:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92543b66f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789265502.651444:0:36:0:(genops.c:885:class_export_put()) final put ffff92543b66a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265502.651446:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b66a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789265502.651450:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265502.651553:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441bee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789265502.651557:0:36:0:(genops.c:885:class_export_put()) final put ffff925441beb800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789265502.651559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441beb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789265502.651564:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789265502.651761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441be9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1789265502.652059:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff925405019800:5825] 0 exiting: rc = 1 00000020:00010000:1.0:1789265502.652520:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92540a4f3000: total 0 00000100:00100000:3.0:1789265502.652632:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652644:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652652:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652659:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652666:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652672:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652677:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652684:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652690:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652696:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652701:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652708:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652714:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652720:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652726:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652732:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652738:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652744:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652751:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652758:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652764:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652771:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652777:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652784:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652790:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652808:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652814:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652830:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652837:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652843:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652851:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652857:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652863:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652870:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652875:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652882:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652887:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652893:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652900:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652906:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652912:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652918:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652924:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652931:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652937:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652942:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652948:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652953:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652958:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652963:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652969:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652974:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652981:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652986:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652991:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.652997:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.653002:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.653008:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.653013:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.653018:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.653032:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.653038:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.653045:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.653051:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1789265502.653541:0:12902:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789265502.653545:0:12902:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1789265502.654442:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92540a4f3000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789265502.654486:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92543bc5ea00/0x8e12577ef818f682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f67b expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.654505:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441885400/0x8e12577ef818f674 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f66d expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.654546:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441884c00/0x8e12577ef818f483 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f47c expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.654557:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92544207cc00/0x8e12577ef818f245 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f23e expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.654571:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137600/0x8e12577ef818f43d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f436 expref: 5 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.654581:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400030a00/0x8e12577ef818f42f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f428 expref: 4 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.654594:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925400031800/0x8e12577ef818f44b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f444 expref: 3 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.654606:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441885e00/0x8e12577ef818f459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e12577ef818f452 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265502.654619:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92540a4f3000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789265502.654633:0:5821:0:(genops.c:885:class_export_put()) final put ffff92540a4f3000/1c534bc8-3a63-4f3a-b547-3e911eb5da8a 00010000:00010000:0.0:1789265502.654690:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265502.654694:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265502.654696:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789265502.655307:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92540a4f3000/1c534bc8-3a63-4f3a-b547-3e911eb5da8a for MGS 00000020:00000080:3.0:1789265502.655729:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92540a4f6800 for MGS 00000020:01000000:0.0:1789265502.655967:0:12902:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff925441431660 - data ffff9254313bd6c0/ffff925304805c00 00000020:01000000:0.0:1789265502.656124:0:12902:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9254050a3000 - data ffff92540cb70510/ffff92540715ec00 00000020:00000080:0.0:1789265502.656719:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f111 00000020:00000080:0.0:1789265502.656727:0:12902:0:(genops.c:885:class_export_put()) final put ffff92540a4f7800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789265502.656745:0:12902:0:(tgt_mount.c:187:server_put_mount()) put mount ffff925409ebd800 from MGS, refs=2 00000020:01000004:0.0:1789265502.656749:0:12902:0:(obd_mount.c:710:lustre_put_lsi()) put ffff925409ebd800 2 00000020:01000004:0.0:1789265502.656766:0:12902:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff925409ebd800 from MGS 00000020:00000080:0.0:1789265502.656788:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265502.656796:0:12902:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789265502.656799:0:12902:0:(genops.c:885:class_export_put()) final put ffff925404c90000/MGS 00000020:00000080:0.0:1789265502.656801:0:12902:0:(genops.c:844:class_export_destroy()) destroying export ffff925404c90000/MGS for MGS 00000020:01000000:0.0:1789265502.656808:0:12902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789265502.657039:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789265502.657044:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265502.657051:0:12902:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265502.657059:0:12902:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff92543bac2800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265502.657066:0:12902:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9254373c0000) has exports, disconnecting them 00000020:00080000:0.0:1789265502.657072:0:12902:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff92543bac2800), last request at 1789265275 00000020:00000080:0.0:1789265502.657078:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f1dc 00000020:00080000:0.0:1789265502.657090:0:12902:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92543bac2800): rc 0 00000020:00000080:0.0:1789265502.657096:0:12902:0:(genops.c:885:class_export_put()) final put ffff92543bac2800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789265502.657795:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92540a4f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265502.657806:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92543bac2800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789265502.658376:0:12902:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789265502.658383:0:12902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265502.658388:0:12902:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789265502.658396:0:12902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265502.658583:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265502.658590:0:12902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789265502.658598:0:12902:0:(obd_mount.c:710:lustre_put_lsi()) put ffff925409ebd800 1 00000020:00000080:1.0:1789265502.658616:0:12902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f103 00000020:00000080:1.0:1789265502.658626:0:12902:0:(genops.c:885:class_export_put()) final put ffff925404c95000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789265502.658631:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789265502.658635:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265502.658639:0:12902:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789265502.658643:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff925403ed0000) has no exports 00000020:00000080:3.0:1789265502.658726:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92543bac3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789265502.658734:0:36:0:(genops.c:885:class_export_put()) final put ffff925441bec800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789265502.658736:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441bec800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789265502.658742:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789265502.658813:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925404c95000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265502.679396:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265502.679417:0:12902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789265502.679424:0:12902:0:(genops.c:885:class_export_put()) final put ffff925404c93000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789265502.679430:0:12902:0:(genops.c:844:class_export_destroy()) destroying export ffff925404c93000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789265502.679442:0:12902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789265502.679906:0:12902:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff925409eb9000 00000020:01000000:3.0:1789265502.679935:0:12902:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789265502.679941:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265502.679947:0:12902:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265502.679952:0:12902:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff925402d74d28) has no exports 00000100:00100000:3.0:1789265502.680041:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff92540ba49800:5834] 1 exiting: rc = 0 00000100:00100000:0.0:1789265502.680300:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9254071a6e00:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1789265502.680312:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff92540ba48400:5835] 2 exiting: rc = 0 00000100:00100000:2.0:1789265502.680450:0:9189:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff925304b43e00:9189] 3 exiting: rc = 0 00000100:00100000:0.0:1789265502.680694:0:9387:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff925441806800:9387] 4 exiting: rc = 0 00000100:00100000:3.0:1789265502.680969:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.680981:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.680988:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.680995:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681001:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681022:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681028:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681034:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681041:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681047:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681054:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681060:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681066:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681072:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681078:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681084:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681090:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681095:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681101:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681106:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681112:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681117:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681122:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681127:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681133:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681139:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681144:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681149:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681155:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681161:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681166:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681173:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681180:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681186:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681191:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681197:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681203:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681209:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681215:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681221:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681236:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681241:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681246:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681252:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681257:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681263:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681270:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681275:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681281:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681287:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681293:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681299:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681304:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681963:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681974:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681980:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681985:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681991:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.681997:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.682003:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.682008:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.682013:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.682020:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.682026:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265502.692302:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff92540851f000:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1789265502.692420:0:12056:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff92541d24f600:12056] 2 exiting: rc = 0 00000100:00100000:0.0:1789265502.692535:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff92540851f200:5837] 1 exiting: rc = 0 00000100:00100000:3.0:1789265502.692781:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692792:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692800:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692806:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692814:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692886:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692894:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692900:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692907:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692915:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692921:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692940:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692948:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692954:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692960:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692966:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692972:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692978:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692984:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692989:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.692994:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693000:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693006:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693012:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693018:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693023:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693029:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693035:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693041:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693047:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693054:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693060:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693067:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693073:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693079:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693086:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693091:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693097:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693103:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693109:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693114:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693120:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693127:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693134:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693140:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693145:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693158:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693164:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693171:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693177:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693183:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693189:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693194:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693200:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693205:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693211:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693217:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693223:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693229:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693235:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693240:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693246:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693251:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.693257:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265502.693832:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff92540c244a00:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1789265502.693977:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff92540c244800:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1789265502.694317:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694327:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694365:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694382:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694392:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694400:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694407:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694415:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694425:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694432:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694444:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694454:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694461:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694468:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694476:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694500:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694508:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694535:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694543:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694550:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694557:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694564:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694571:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694578:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694584:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694590:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694598:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694619:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694627:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694633:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694640:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694646:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694653:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694659:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694667:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694674:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694681:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694687:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694694:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694715:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694724:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694731:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694737:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694743:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694750:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694757:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694771:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694780:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694786:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694792:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694798:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694920:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694934:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694941:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694953:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694960:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694967:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694974:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694983:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694991:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.694998:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.695005:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.695012:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.695026:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265502.711391:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff92540a4bf400:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1789265502.711660:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff92540a4bec00:5841] 1 exiting: rc = 0 00000100:00100000:3.0:1789265502.711988:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.711999:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712006:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712013:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712019:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712024:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712030:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712035:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712041:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712048:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712053:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712058:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712063:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712068:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712073:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712078:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712083:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712089:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712095:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712100:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712105:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712111:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712117:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712139:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712144:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712150:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712155:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712160:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712165:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712170:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712176:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712183:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712189:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712197:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712205:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712216:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712223:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712228:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712233:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712238:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712244:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712249:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712254:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712260:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712265:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712270:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712277:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712283:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712295:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712305:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712314:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712320:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712324:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712328:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712516:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712532:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712538:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712544:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712556:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712562:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712641:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712648:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712653:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.712659:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265502.713599:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff92540a4bee00:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1789265502.713763:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff92540a4bfc00:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1789265502.714069:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714078:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714083:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714089:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714094:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714099:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714104:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714109:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714115:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714120:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714126:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714131:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714136:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714141:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714147:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714152:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714157:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714162:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714167:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714172:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714177:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714182:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714187:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714192:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714197:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714201:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714206:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714211:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714215:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714236:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714242:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714248:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714254:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714259:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714264:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714270:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714275:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714279:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714285:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714290:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714294:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714299:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714305:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714310:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714314:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714319:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714324:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714353:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714361:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714366:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714372:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714377:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714381:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714387:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714391:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714396:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714401:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714406:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714412:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714418:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714423:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714428:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714433:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.714438:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265502.717289:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff92540a844a00:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1789265502.717473:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff92540a844800:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1789265502.717849:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717860:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717866:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717871:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717877:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717884:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717890:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717896:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717902:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717907:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717914:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717920:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717926:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717932:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717938:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717944:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717950:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717955:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717961:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717967:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717974:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717980:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717985:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717991:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.717997:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718003:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718153:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718159:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718165:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718182:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718188:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718193:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718200:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718207:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718213:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718240:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718245:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718250:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718255:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718261:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718266:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718272:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718279:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718285:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718291:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718296:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718301:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718306:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718312:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718318:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718324:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718380:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718389:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718395:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718404:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718412:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718421:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718432:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718438:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718444:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718448:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718454:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718460:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.718466:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265502.719128:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff92540c31f600:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1789265502.719549:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff92540a845a00:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1789265502.720035:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff92540c31fa00:5848] 2 exiting: rc = 0 00000100:00100000:3.0:1789265502.720155:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720165:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720171:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720177:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720182:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720189:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720216:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720223:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720232:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720240:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720247:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720255:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720263:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720271:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720280:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720289:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720297:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720305:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720313:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720319:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720327:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720351:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720371:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720379:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720385:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720392:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720398:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720406:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720412:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720419:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720425:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720431:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720438:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720443:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720661:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720677:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720688:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720699:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720713:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720721:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720727:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720745:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720753:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720759:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720766:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720773:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720796:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720805:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720813:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720818:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720825:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720834:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720840:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720847:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720854:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720861:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720867:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720874:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720880:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720887:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720894:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720899:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720906:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265502.720913:0:12902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789265502.726967:0:12902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265502.726989:0:12902:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789265502.726996:0:12902:0:(genops.c:885:class_export_put()) final put ffff92540a815000/MDS_uuid 00000020:00000080:2.0:1789265502.727003:0:12902:0:(genops.c:844:class_export_destroy()) destroying export ffff92540a815000/MDS_uuid for MDS 00000020:01000000:2.0:1789265502.727011:0:12902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789265502.727296:0:12902:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789265502.750681:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265503.137927:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553780480:0@lo:400:kworker.0 00000400:00000100:0.0:1789265503.138004:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180553780480 offset 0 length 224: 4 00000100:00100000:0.0:1789265503.138094:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265503.138108:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553780608:0@lo:400:kworker.0 00000400:00000100:0.0:1789265503.138129:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180553780608 offset 0 length 224: 4 00000100:00100000:1.0:1789265503.138658:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553780352:0@lo:400:kworker.0 00000400:00000100:1.0:1789265503.138697:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180553780352 offset 0 length 224: 4 00000001:00100000:1.0:1789265503.717460:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789265503.717473:0:7630:0:(genops.c:885:class_export_put()) final put ffff92543b669000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789265503.717519:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:1.0:1789265503.717523:0:7630:0:(genops.c:885:class_export_put()) final put ffff925403fc8000/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa 00000020:00000080:2.0:1789265503.717530:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b669000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789265503.717602:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925403fc8000/b9773a89-f93c-421a-9c50-bfa3d5c6f2fa for lustre-OST0001 00000020:00000080:2.0:1789265503.717654:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92543b66a800 for lustre-OST0001 00000020:00000080:2.0:1789265503.717666:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925403fca000 for lustre-OST0001 00010000:00010000:0.0:1789265503.776977:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265504.798513:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789265505.587251:0:13053:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789265505.605849:0:13053:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789265505.605917:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265505.605934:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265505.605942:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265505.605948:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265505.605988:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789265505.605994:0:13053:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789265505.606023:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265505.606039:0:13053:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92544185f480 x1876180553780480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265519 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265505.606068:0:13053:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789265505.606076:0:13053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789265505.606110:0:13053:0:(import.c:65:import_set_state_nolock()) ffff9253048c5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789265505.606149:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876180553780736:0@lo:39:umount.0 00000400:00000100:1.0:1789265505.606218:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180553780736 offset 0 length 224: 4 00000100:00100000:3.0:1789265505.606242:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553780480:0@lo:400:kworker.0 00010000:00010000:0.0:1789265505.606722:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265505.606733:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265505.606745:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:0.0:1789265505.606749:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265505.606760:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265505.606769:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265505.606776:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265505.606780:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789265505.606783:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789265505.606819:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265505.606827:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265505.606859:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265505.606867:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403137000/0x8e12577ef818f444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e12577ef818f44b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265505.606880:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265505.606882:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265505.606894:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265505.606915:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553780864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265505.606970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265505.607112:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553780864 00000100:00100000:0.0:1789265505.607121:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553780864 00000100:00100000:0.0:1789265505.607178:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265505.607189:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1876180553780864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265505.607196:0:11653:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265505 with bad export cookie 10237341105806438694 00000100:00100000:1.0:1789265505.621644:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1876180553780864:12345-0@lo:103:ldlm_bl.0 Request processed in 14441us (14660us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789265505.621663:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789265505.621673:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789265505.621682:0:3306:0:(import.c:65:import_set_state_nolock()) ffff925402d5a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789265505.621686:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789265505.631277:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.143@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789265505.631285:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789265505.631318:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92544185ca80 x1876180553780352/t0(0) o400->MGC192.168.204.143@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789265519 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265505.631366:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92544185ed80 x1876180553780864/t0(0) o103->MGC192.168.204.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265521 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789265505.631377:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789265505.631381:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789265505.631383:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789265505.631389:0:3306:0:(import.c:65:import_set_state_nolock()) ffff925402d5a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265505.631395:0:3306:0:(import.c:510:import_select_connection()) MGC192.168.204.143@tcp: connect to NID 0@lo last attempt 129 00000100:00080000:3.0:1789265505.631407:0:3306:0:(import.c:624:import_select_connection()) MGC192.168.204.143@tcp: import ffff925402d5a000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1789265505.631450:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9f480 x1876180553780992/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265505.631502:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3307:1876180553780352:0@lo:400:kworker.0 00000100:00100000:3.0:1789265505.631512:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3306:1876180553780864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265505.632042:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3303:1876180553780992:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1789265505.632111:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180553780992 offset 0 length 520: 4 00010000:00010000:3.0:1789265505.822513:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789265506.264234:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789265506.264244:0:6704:0:(genops.c:885:class_export_put()) final put ffff925304b50000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265506.264449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925304b50000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789265506.264594:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925304b53000 for lustre-OST0000 00010000:00010000:0.0:1789265506.846685:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265507.870686:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265508.254853:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789265508.254866:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265508.254988:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553781120:0@lo:400:kworker.0 00000400:00000100:1.0:1789265508.255111:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180553781120 offset 0 length 224: 4 00010000:00010000:0.0:1789265508.894827:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265509.918540:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265510.302566:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789265510.302577:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265510.302868:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265510.303470:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553781248:0@lo:400:kworker.0 00000400:00000100:1.0:1789265510.303532:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180553781248 offset 0 length 224: 4 00010000:00010000:0.0:1789265510.942587:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265511.966867:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265512.991453:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265514.014539:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265515.039990:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265515.423455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265515.423465:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265515.423680:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265515.423705:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553781376:0@lo:400:kworker.0 00000400:00000100:0.0:1789265515.423761:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180553781376 offset 0 length 224: 4 00000100:00100000:1.0:1789265515.934622:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265505/real 1789265505] req@ffff925441a9f480 x1876180553780992/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265515.934687:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff925441a9f480 x1876180553780992/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265515.934698:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265505/real 1789265505] req@ffff92543be41180 x1876180553780736/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265515.934711:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92543be41180 x1876180553780736/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265515.934733:0:3303:0:(import.c:65:import_set_state_nolock()) ffff925402d5a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265515.934755:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789265515.934760:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3303:1876180553780992:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1789265515.934766:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9253048c5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789265515.934782:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876180553780736:0@lo:39:umount.0 00000100:00080000:1.0:1789265515.934851:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265515.934857:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789265515.934860:0:36:0:(import.c:65:import_set_state_nolock()) ffff925402d5a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265515.934865:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.143@tcp: connect to NID 0@lo last attempt 360 00000100:00080000:1.0:1789265515.934870:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.143@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265515.934877:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.143@tcp: import ffff925402d5a000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1789265515.934908:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92543be41180 x1876180553781504/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265515.934981:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265515.934992:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553781632:0@lo:400:kworker.0 00000400:00000100:1.0:1789265515.935052:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180553781632 offset 0 length 224: 4 00000100:00080000:0.0:1789265515.935197:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265515.935202:0:13053:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265515.935207:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789265515.935520:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3303:1876180553781504:0@lo:250:kworker.0 00000400:00000100:2.0:1789265515.935547:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180553781504 offset 0 length 520: 4 00010000:00010000:0.0:1789265515.937421:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265515.937460:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265515.937468:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265515.937475:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265515.937512:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265515.937519:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265515.937526:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265515.937531:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265515.937538:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265515.937559:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789265515.937563:0:13053:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789265515.937589:0:13053:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789265515.937593:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789265515.937598:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265515.937603:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265515.937607:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff925403ed4d28) has no exports 00000020:00080000:0.0:1789265515.937640:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff925403ed4d28) has no exports 00010000:00010000:3.0:1789265515.937650:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265515.937660:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265515.937670:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265515.937673:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265515.937683:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265515.937701:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265515.937706:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265515.937708:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789265515.937710:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789265515.937725:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925402d5a000 00010000:00010000:3.0:1789265515.937729:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265515.937737:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030e00/0x8e12577ef818f452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f459 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265515.937755:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265515.937758:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265515.937764:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e200 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265515.937766:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265515.937772:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265515.937778:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265515.937782:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789265515.937784:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789265515.937792:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789265515.937799:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925402d5a000 00010000:00010000:3.0:1789265515.937801:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265515.937807:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef818f67b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f682 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265515.937815:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265515.937817:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265515.937819:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265515.938359:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789265515.942313:0:13053:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92540b2e6180 - data ffff925431376d80/ffff92540809e000 00000020:01000000:0.0:1789265515.942930:0:13053:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92541d34b120 - data ffff92530458f510/ffff925304b46800 00100000:10000000:0.0:1789265515.949226:0:13053:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789265515.982112:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f261 00000020:00000080:0.0:1789265515.982124:0:13053:0:(genops.c:885:class_export_put()) final put ffff925304264800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789265515.982141:0:13053:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92543b68a800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789265515.982145:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92543b68a800 2 00000020:01000004:0.0:1789265515.982148:0:13053:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92543b68a800 from lustre-OST0000 00000020:00000080:0.0:1789265515.982190:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265515.982201:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789265515.982203:0:13053:0:(genops.c:885:class_export_put()) final put ffff925304264000/lustre-OST0000_UUID 00000020:00000080:0.0:1789265515.982206:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff925304264000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789265515.982213:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789265515.982259:0:13053:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789265515.982274:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789265515.982278:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265515.982283:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265515.982289:0:13053:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff92543b479800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265515.982294:0:13053:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff925402d719b8) has exports, disconnecting them 00000020:00080000:0.0:1789265515.982299:0:13053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff92543b479800), last request at 1789265296 00000020:00000080:0.0:1789265515.982303:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f28b 00000020:00080000:0.0:1789265515.982312:0:13053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92543b479800): rc 0 00000020:00000080:0.0:1789265515.982317:0:13053:0:(genops.c:885:class_export_put()) final put ffff92543b479800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789265515.983091:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925304264800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789265515.983108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b479800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789265515.983556:0:13053:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789265515.983561:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265515.983565:0:13053:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789265515.983572:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265515.983595:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9253048c5000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789265515.983770:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265515.983777:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789265515.983781:0:13053:0:(genops.c:885:class_export_put()) final put ffff9253048c5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789265515.983784:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff9253048c5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789265515.983788:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789265515.983847:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92543b68a800 1 00000020:00000080:1.0:1789265515.983852:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f21b 00000020:00000080:1.0:1789265515.983859:0:13053:0:(genops.c:885:class_export_put()) final put ffff925403516000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789265515.983867:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789265515.983874:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925403516000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789265515.983883:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265515.983887:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265515.983890:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff92543d3bb370) has no exports 00000020:00000080:1.0:1789265515.998993:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265515.999012:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789265515.999020:0:13053:0:(genops.c:885:class_export_put()) final put ffff92543b68b800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789265515.999025:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b68b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789265515.999033:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789265515.999203:0:13053:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92543b688000 00000020:02000400:1.0:1789265515.999254:0:13053:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789265516.062488:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265517.090682:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265518.112410:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265518.543829:0:13207:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789265518.557495:0:13207:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789265518.557591:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265518.557606:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265518.557614:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265518.557752:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265518.557770:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265518.557775:0:13207:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789265518.557797:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265518.557808:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92544185d500 x1876180553780608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265519 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789265518.557918:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265518.557926:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265518.557945:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1789265518.557949:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265518.557959:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265518.557967:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265518.557973:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265518.557975:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789265518.557978:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789265518.557992:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925402d5a000 00010000:00010000:1.0:1789265518.557995:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265518.558002:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925403136e00/0x8e12577ef818f428 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f42f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265518.558013:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265518.558015:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265518.558016:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265518.558705:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92544185ea00 x1876180553781120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265524 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265518.558775:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92544185df80 x1876180553781248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265526 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265518.558799:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff925441a9df80 x1876180553781376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265531 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265518.558809:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92543be42300 x1876180553781632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265531 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265518.558817:0:13207:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265518.558824:0:13207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265518.558865:0:13207:0:(import.c:65:import_set_state_nolock()) ffff92543b66d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789265518.558902:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876180553781760:0@lo:39:umount.0 00000400:00000100:2.0:1789265518.558967:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180553781760 offset 0 length 224: 4 00000100:00100000:0.0:1789265518.559117:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553781248:0@lo:400:kworker.0 00000100:00100000:1.0:1789265518.559483:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553781120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265518.559498:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876180553781632:0@lo:400:kworker.0 00000100:00100000:3.0:1789265518.559645:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553780608:0@lo:400:kworker.0 00000100:00100000:3.0:1789265518.559660:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553781376:0@lo:400:kworker.0 00010000:00010000:3.0:1789265519.134610:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265520.158503:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265521.054847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789265521.054863:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789265521.183893:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265522.208758:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265523.230688:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265524.255412:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265525.279357:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265526.174471:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265526.174485:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789265526.302742:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265527.329262:0:11651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265528.350690:0:11652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265528.798960:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265518/real 1789265518] req@ffff925437482680 x1876180553781760/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265528 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265528.799004:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff925437482680 x1876180553781760/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265528 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265528.799065:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b66d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789265528.799166:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876180553781760:0@lo:39:umount.0 00000100:00080000:0.0:1789265528.802497:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265528.802505:0:13207:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265528.802513:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789265528.803531:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.803546:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.803553:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.803559:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.803593:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265528.803600:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.803606:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.803612:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.803617:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.803649:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789265528.803654:0:13207:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789265528.803679:0:13207:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789265528.803683:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789265528.803687:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265528.803693:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1789265528.803694:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1789265528.803697:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff925402d73370) has no exports 00010000:00010000:3.0:1789265528.803701:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.803707:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030400 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265528.803710:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789265528.803720:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff925402d73370) has no exports 00010000:00010000:3.0:1789265528.803724:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265528.803732:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265528.803749:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265528.803752:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789265528.803754:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789265528.803768:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925402d5a000 00010000:00010000:3.0:1789265528.803771:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.803778:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400030400/0x8e12577ef818f436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f43d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.803794:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265528.803797:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.803803:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995a00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265528.803806:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.803812:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265528.803818:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265528.803832:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789265528.803834:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789265528.803836:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789265528.803841:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925402d5a000 00010000:00010000:3.0:1789265528.803843:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.803850:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925441995a00/0x8e12577ef818f66d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f674 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.803862:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265528.803864:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265528.803866:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265528.804384:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789265528.818602:0:13207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92540b2e6720 - data ffff9254313761b0/ffff9254377e7400 00000020:01000000:1.0:1789265528.819482:0:13207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92540b3d2d20 - data ffff925431275510/ffff9253069a7800 00100000:10000000:1.0:1789265528.834158:0:13207:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789265528.865569:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f32c 00000020:00000080:1.0:1789265528.865580:0:13207:0:(genops.c:885:class_export_put()) final put ffff925441864000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789265528.865597:0:13207:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9253050fe800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789265528.865600:0:13207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9253050fe800 2 00000020:01000004:1.0:1789265528.865603:0:13207:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9253050fe800 from lustre-OST0001 00000020:00000080:1.0:1789265528.865628:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265528.865640:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789265528.865643:0:13207:0:(genops.c:885:class_export_put()) final put ffff9253050fc000/lustre-OST0001_UUID 00000020:00000080:1.0:1789265528.865646:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff9253050fc000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789265528.865654:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789265528.866052:0:13207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1c534bc8-3a63-4f3a-b547-3e911eb5da8a->MGS 00010000:00010000:1.0:1789265528.866072:0:13207:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f245 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265528.866085:0:13207:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f245 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265528.866092:0:13207:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789265528.866095:0:13207:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789265528.866099:0:13207:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789265528.866116:0:13207:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925402d5a000 00010000:00010000:1.0:1789265528.866119:0:13207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925400031600/0x8e12577ef818f23e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f245 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265528.866136:0:13207:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e12577ef818f483 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265528.866144:0:13207:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e12577ef818f483 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265528.866164:0:13207:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265528.866166:0:13207:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789265528.866168:0:13207:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789265528.866181:0:13207:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925402d5a000 00010000:00010000:1.0:1789265528.866184:0:13207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff9254013c2000/0x8e12577ef818f47c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e12577ef818f483 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789265528.866205:0:13207:0:(import.c:65:import_set_state_nolock()) ffff925402d5a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789265528.866209:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789265528.866211:0:13207:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789265528.866213:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789265528.866217:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789265528.866229:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92543be41180 x1876180553781504/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789265530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789265528.866255:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789265528.866258:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:3.0:1789265528.866366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925441864000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789265528.869137:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1c534bc8-3a63-4f3a-b547-3e911eb5da8a:3303:1876180553781504:0@lo:250:kworker.0 10000000:01000000:1.0:1789265528.869232:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789265528.869249:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f11f 00000020:00000080:1.0:1789265528.869258:0:13207:0:(genops.c:885:class_export_put()) final put ffff92540a816000/1c534bc8-3a63-4f3a-b547-3e911eb5da8a 00000020:01000000:1.0:1789265528.869319:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.143@tcp (flags='') 00000020:00000080:1.0:1789265528.869363:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265528.869373:0:13207:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.143@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265528.869378:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff925402d54d28) has no exports 10000000:01000000:2.0:1789265528.869468:0:5831:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789265528.869627:0:13207:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.143@tcp: client import never connected 00000100:00080000:1.0:1789265528.869632:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789265528.869636:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789265528.869639:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789265528.869641:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789265528.869872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92540a816000/1c534bc8-3a63-4f3a-b547-3e911eb5da8a for MGC192.168.204.143@tcp 00000020:00000080:1.0:1789265528.869980:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265528.869989:0:13207:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.143@tcp (uuid 1c534bc8-3a63-4f3a-b547-3e911eb5da8a) 00000020:01000000:1.0:1789265528.869995:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789265528.870009:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265528.870024:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789265528.870029:0:13207:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff92543b66e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265528.870035:0:13207:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9254373c19b8) has exports, disconnecting them 00000020:00080000:1.0:1789265528.870040:0:13207:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff92543b66e800), last request at 1789265314 00000020:00000080:1.0:1789265528.870044:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f356 00000020:00080000:1.0:1789265528.870057:0:13207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92543b66e800): rc 0 00000020:00000080:1.0:1789265528.870061:0:13207:0:(genops.c:885:class_export_put()) final put ffff92543b66e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789265528.870227:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925402d5a000 for MGC192.168.204.143@tcp 00000020:00000080:3.0:1789265528.870235:0:36:0:(genops.c:885:class_export_put()) final put ffff92540c23f000/1c534bc8-3a63-4f3a-b547-3e911eb5da8a 00000020:00000080:3.0:1789265528.870237:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92540c23f000/1c534bc8-3a63-4f3a-b547-3e911eb5da8a for MGC192.168.204.143@tcp 00000020:01000000:3.0:1789265528.870242:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.143@tcp (1c534bc8-3a63-4f3a-b547-3e911eb5da8a) 00000020:00000080:3.0:1789265528.870817:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b66e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789265528.871965:0:13207:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789265528.871973:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265528.871978:0:13207:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789265528.871984:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789265528.872202:0:11651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1789265528.872368:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92543b66d800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789265528.872704:0:11652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789265528.873026:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1789265528.873255:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1789265528.873473:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9254211b0e00:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1789265528.873530:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9254211b1400:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1789265528.873687:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874147:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff92540997fe00:5818] 0 exiting: rc = 1 00000100:00100000:3.0:1789265528.874207:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9254387a5e00:5820] 2 exiting: rc = 0 00000100:00100000:3.0:1789265528.874264:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff92540997f000:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1789265528.874525:0:11653:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff92543bbfac00:11653] 3 exiting: rc = 0 00000100:00100000:3.0:1789265528.874690:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874699:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874707:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874713:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874721:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874727:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874733:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874740:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874745:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874750:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874756:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874762:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874767:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874773:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874780:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874785:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874791:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874796:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874800:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874807:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874811:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874816:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874821:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874825:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874830:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874835:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874839:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874845:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874851:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874856:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874861:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874879:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874885:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874890:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874896:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874901:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874907:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874913:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874929:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874936:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874941:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874947:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874952:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874957:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874962:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874966:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874971:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874977:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.874982:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875005:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875011:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875026:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875031:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875037:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875041:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875047:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875053:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875058:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875063:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875069:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875073:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875079:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875084:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.875090:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789265528.876385:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265528.876397:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789265528.876413:0:13207:0:(genops.c:885:class_export_put()) final put ffff92543b66e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789265528.876418:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff92543b66e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789265528.876428:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789265528.876591:0:13207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9253050fe800 1 00000020:00000080:3.0:1789265528.876598:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8e12577ef818f2fb 00000020:00000080:3.0:1789265528.876608:0:13207:0:(genops.c:885:class_export_put()) final put ffff9253048c3000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789265528.876627:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789265528.876633:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265528.876638:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789265528.876642:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff925402d70000) has no exports 00000020:00000080:0.0:1789265528.876761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9253048c3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789265528.894303:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265528.894320:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789265528.894326:0:13207:0:(genops.c:885:class_export_put()) final put ffff9253050f8800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789265528.894351:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff9253050f8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789265528.894360:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789265528.894599:0:13207:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9253050ff000 00000020:01000000:0.0:1789265528.894626:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789265528.894631:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265528.894636:0:13207:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265528.894640:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9254373c3370) has no exports 00000020:00000080:0.0:1789265528.894672:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265528.894679:0:13207:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789265528.894682:0:13207:0:(genops.c:885:class_export_put()) final put ffff925403515000/OSS_uuid 00000020:00000080:0.0:1789265528.894693:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff925403515000/OSS_uuid for OSS 00000020:01000000:0.0:1789265528.894697:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789265528.894956:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff925436f52e00:6681] 2 exiting: rc = 0 00000100:00100000:2.0:1789265528.895195:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff925436f52800:6678] 0 exiting: rc = 1 00000100:00100000:0.0:1789265528.897820:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff92544136ca00:6680] 1 exiting: rc = 0 00000100:00100000:0.0:1789265528.897930:0:9090:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff92540851ec00:9090] 3 exiting: rc = 0 00000100:00080000:0.0:1789265528.897978:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789265528.898083:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898091:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898108:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898117:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898122:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898127:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898132:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898139:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898144:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898150:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898155:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898161:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898166:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898171:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898176:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898181:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898186:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898191:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898197:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898202:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898208:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898214:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898221:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898227:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898232:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898238:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898244:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898250:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898255:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898260:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898280:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898286:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898291:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898296:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898301:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898306:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898310:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898316:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898321:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898329:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898357:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898364:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898370:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898376:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898381:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898387:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898393:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898399:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898405:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898411:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898417:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898422:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898428:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898434:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898442:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898448:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898455:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898462:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898468:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898475:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898483:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898488:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898493:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.898498:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265528.899689:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff92543b52ee00:6683] 1 exiting: rc = 0 00000100:00100000:2.0:1789265528.900185:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff92544136d800:6682] 0 exiting: rc = 1 00000100:00100000:0.0:1789265528.901208:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901236:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901241:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901270:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901278:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901283:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901288:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901293:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901298:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901305:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901311:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901317:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901322:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901328:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901349:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901355:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901360:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901365:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901371:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901376:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901381:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901386:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901390:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901396:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901401:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901407:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901412:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901417:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901423:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901429:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901434:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901440:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901445:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901451:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901468:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901476:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901490:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901496:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901501:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901506:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901512:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901518:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901523:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901529:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901535:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901541:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901546:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901552:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901557:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901563:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901568:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901574:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901579:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901584:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901589:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901594:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901599:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901604:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901610:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901615:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901620:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901624:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901629:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.901634:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.902589:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff92540a5f0400:6686] 2 exiting: rc = 0 00000100:00100000:3.0:1789265528.903210:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff92540a5f1e00:6685] 1 exiting: rc = 0 00000100:00100000:2.0:1789265528.905843:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9254372ba400:6684] 0 exiting: rc = 1 00000100:00100000:0.0:1789265528.906427:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906438:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906444:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906450:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906456:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906479:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906507:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906514:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906520:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906526:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906531:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906536:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906542:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906548:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906554:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906570:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906576:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906582:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906587:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906593:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906599:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906605:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906611:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906616:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906622:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906628:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906634:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906641:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906647:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906653:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906674:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906682:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906688:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906693:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906699:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906705:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906710:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906716:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906722:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906728:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906734:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906746:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906751:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906757:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906763:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906769:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906775:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906780:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906786:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906792:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906798:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906803:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906809:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906815:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906821:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906828:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906834:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906839:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906845:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906851:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906856:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906862:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906867:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.906873:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.914399:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff925437629c00:6687] 0 exiting: rc = 1 00000100:00100000:3.0:1789265528.914855:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff925437628e00:6688] 1 exiting: rc = 0 00000100:00100000:0.0:1789265528.915474:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915483:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915489:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915496:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915502:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915508:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915513:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915518:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915523:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915528:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915534:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915553:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915559:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915565:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915570:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915576:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915581:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915586:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915591:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915597:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915601:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915606:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915612:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915617:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915622:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915627:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915633:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915638:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915644:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915650:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915655:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915661:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915667:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915673:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915680:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915686:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915692:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915697:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915702:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915708:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915713:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915718:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915723:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915729:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915734:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915739:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915753:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915758:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915763:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915768:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915774:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915785:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915792:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915797:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915803:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915809:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915814:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915820:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915825:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915831:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915836:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915841:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915846:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.915857:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265528.920382:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9254093c0600:6689] 0 exiting: rc = 1 00000100:00100000:2.0:1789265528.920888:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff925437198600:6690] 1 exiting: rc = 0 00000100:00100000:0.0:1789265528.921106:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921114:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921120:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921126:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921133:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921141:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921148:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921165:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921173:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921179:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921186:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921193:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921201:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921207:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921215:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921222:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921229:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921249:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921255:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921278:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921286:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921292:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921298:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921304:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921310:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921316:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921327:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921647:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921655:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921661:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921667:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921690:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921697:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921708:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921715:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921720:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921727:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921733:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921811:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921818:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921824:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921834:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921841:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921862:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921871:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921879:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921886:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921893:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921898:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921904:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921910:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921920:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921938:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921944:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921950:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921971:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921979:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921985:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921991:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.921998:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.922004:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.922010:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.923000:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265528.923006:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789265528.945908:0:13207:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789265545.557908:0:13827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789265554.022434:0:14288:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789265554.022441:0:14288:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789265554.022712:0:14288:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92543bbd7000 00000020:01000004:0.0:1789265554.022732:0:14288:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789265554.022740:0:14288:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789265554.022758:0:14288:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff925402d70000) 00000020:00000080:0.0:1789265554.022772:0:14288:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789265554.034663:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789265554.036640:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789265554.037028:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 289: rc = 0 00100000:10000000:0.0:1789265554.037130:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 289: rc = 0 00100000:10000000:0.0:1789265554.037448:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789265554.037540:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 289: rc = 0 00100000:10000000:0.0:1789265554.037640:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 289: rc = 0 00100000:10000000:0.0:1789265554.037742:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 289: rc = 0 00100000:10000000:0.0:1789265554.037843:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 289: rc = 0 00100000:10000000:0.0:1789265554.038098:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 291: rc = 0 00100000:10000000:0.0:1789265554.039129:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 769: rc = 0 00100000:10000000:0.0:1789265554.039235:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 769: rc = 0 00100000:10000000:0.0:1789265554.039856:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1789265554.040113:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 655: rc = 0 00100000:10000000:0.0:1789265554.040466:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 655: rc = 0 00100000:10000000:0.0:1789265554.040746:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1789265554.040980:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 655: rc = 0 00100000:10000000:0.0:1789265554.041234:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1789265554.041651:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1789265554.041922:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 655: rc = 0 00100000:10000000:0.0:1789265554.042174:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1789265554.042428:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 655: rc = 0 00100000:10000000:0.0:1789265554.042678:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 655: rc = 0 00100000:10000000:0.0:1789265554.042914:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1789265554.043297:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 450: rc = 0 00100000:10000000:0.0:1789265554.043650:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 450: rc = 0 00100000:10000000:0.0:1789265554.043865:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 450: rc = 0 00100000:10000000:0.0:1789265554.044112:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 450: rc = 0 00100000:10000000:0.0:1789265554.044430:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 450: rc = 0 00100000:10000000:0.0:1789265554.044698:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 450: rc = 0 00100000:10000000:0.0:1789265554.044923:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 450: rc = 0 00100000:10000000:0.0:1789265554.045163:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 450: rc = 0 00100000:10000000:0.0:1789265554.045513:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 450: rc = 0 00100000:10000000:0.0:1789265554.045817:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 450: rc = 0 00100000:10000000:0.0:1789265554.046058:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 450: rc = 0 00100000:10000000:0.0:1789265554.046296:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 450: rc = 0 00100000:10000000:0.0:1789265554.046586:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 450: rc = 0 00100000:10000000:0.0:1789265554.046845:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 450: rc = 0 00100000:10000000:0.0:1789265554.047102:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 450: rc = 0 00100000:10000000:0.0:1789265554.047457:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 450: rc = 0 00100000:10000000:0.0:1789265554.047789:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 450: rc = 0 00100000:10000000:0.0:1789265554.048040:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 450: rc = 0 00100000:10000000:0.0:1789265554.048283:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 450: rc = 0 00100000:10000000:0.0:1789265554.048656:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 450: rc = 0 00100000:10000000:0.0:1789265554.049156:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 450: rc = 0 00100000:10000000:0.0:1789265554.049568:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 450: rc = 0 00100000:10000000:0.0:1789265554.049916:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 450: rc = 0 00100000:10000000:0.0:1789265554.050172:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 450: rc = 0 00100000:10000000:0.0:1789265554.050450:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 450: rc = 0 00100000:10000000:0.0:1789265554.050734:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 450: rc = 0 00100000:10000000:0.0:1789265554.050980:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 450: rc = 0 00100000:10000000:0.0:1789265554.051248:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 450: rc = 0 00100000:10000000:0.0:1789265554.051551:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 450: rc = 0 00100000:10000000:0.0:1789265554.051814:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 450: rc = 0 00100000:10000000:0.0:1789265554.052071:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 450: rc = 0 00100000:10000000:0.0:1789265554.052314:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 450: rc = 0 00100000:10000000:0.0:1789265554.052971:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 669: rc = 0 00100000:10000000:0.0:1789265554.053575:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1789265554.053753:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 651: rc = 0 00100000:10000000:0.0:1789265554.053950:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1789265554.054014:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 651: rc = 0 00100000:10000000:0.0:1789265554.054216:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1789265554.054285:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 651: rc = 0 00100000:10000000:0.0:1789265554.054755:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1789265554.054830:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 438: rc = 0 00100000:10000000:0.0:1789265554.055016:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1789265554.055087:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 438: rc = 0 00100000:10000000:0.0:1789265554.055263:0:14288:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1789265554.055327:0:14288:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 438: rc = 0 00000020:00000080:0.0:1789265554.055640:0:14288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789265554.055651:0:14288:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789265554.055661:0:14288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef8190420 00000020:01000004:0.0:1789265554.055670:0:14288:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789265554.055675:0:14288:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789265554.055680:0:14288:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92543bbd7000 from MGS 00000020:01000004:0.0:1789265554.055684:0:14288:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789265554.055694:0:14288:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff925402d73370) 00000020:00000080:0.0:1789265554.055702:0:14288:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789265554.055761:0:14288:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92543bbd7000 from MGS, refs=2 00080000:01000000:0.0:1789265554.055766:0:14288:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789265554.055771:0:14288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef819042e 00000100:00100000:0.0:1789265554.055869:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789265554.056013:0:14288:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789265554.056020:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789265554.056624:0:14288:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789265554.056631:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789265554.057240:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265554.057591:0:14288:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789265554.057596:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789265554.058113:0:14288:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789265554.058121:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789265554.058742:0:14288:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789265554.058749:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789265554.059394:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.059398:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.059400:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.059708:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.059710:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.059712:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265554.060145:0:14288:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789265554.064491:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789265554.069794:0:14288:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789265554.069812:0:14288:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789265554.069815:0:14288:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789265554.071372:0:14297:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789265554.071506:0:14288:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789265554.071615:0:14288:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789265554.072159:0:14288:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789265554.072534:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265554.072715:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789265554.072720:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789265554.082745:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789265554.082795:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789265554.083213:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789265554.083220:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1789265554.084430:0:14302:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789265554.084636:0:14288:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789265554.084657:0:14288:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.143@tcp' 00000020:01000004:3.0:1789265554.084659:0:14288:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789265554.084693:0:14288:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.143@tcp (typ=mgc) 00000020:00000080:3.0:1789265554.084706:0:14288:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.143@tcp (ffff92543d3b8000) 00000020:00000080:3.0:1789265554.084721:0:14288:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789265554.084795:0:14288:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92540a457000@MGC192.168.204.143@tcp: add connection 192.168.204.143@tcp at head 00010000:00010000:3.0:1789265554.084952:0:14288:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.143@tcp-0 is initialized 00000040:01000000:3.0:1789265554.084958:0:14288:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789265554.085489:0:14303:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789265554.085565:0:14288:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.143@tcp (uuid 3c79c9cb-ef4c-488b-80e5-fba066317ec7) 00000020:00000080:0.0:1789265554.085581:0:14288:0:(genops.c:1385:class_connect()) connect: client 3c79c9cb-ef4c-488b-80e5-fba066317ec7, cookie 0x8e12577ef819043c 00000100:00080000:0.0:1789265554.085591:0:14288:0:(import.c:510:import_select_connection()) MGC192.168.204.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265554.085596:0:14288:0:(import.c:624:import_select_connection()) MGC192.168.204.143@tcp: import ffff92540a457000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1789265554.085627:0:14288:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92544185df80 x1876180553781888/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265554.085656:0:14288:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3c79c9cb-ef4c-488b-80e5-fba066317ec7->MGS 00000020:01000004:0.0:1789265554.085676:0:14288:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789265554.085681:0:14288:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789265554.085692:0:14288:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff925402d719b8) 00000020:00000080:0.0:1789265554.085701:0:14288:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789265554.085856:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3303:1876180553781888:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789265554.085926:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.086707:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553781888 00000100:00100000:1.0:1789265554.086716:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553781888 00000100:00100000:1.0:1789265554.086753:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265554.086760:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a82e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3303:x1876180553781888:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789265554.086782:0:14300:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3c79c9cb-ef4c-488b-80e5-fba066317ec7@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:1.0:1789265554.086803:0:14300:0:(genops.c:1385:class_connect()) connect: client 3c79c9cb-ef4c-488b-80e5-fba066317ec7, cookie 0x8e12577ef819044a 00000100:00080000:1.0:1789265554.086924:0:14300:0:(import.c:65:import_set_state_nolock()) ffff92543bbc3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265554.086991:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a82e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+5:3303:x1876180553781888:12345-0@lo:250:mount.lustre.0 Request processed in 229us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265554.086999:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265554.087046:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789265554.087054:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.143@tcp: connect to target with instance 0 00000100:00080000:1.0:1789265554.087061:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789265554.087075:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789265554.087078:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92540a457000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789265554.087080:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789265554.087097:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789265554.087103:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3303:1876180553781888:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789265554.104884:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265554.105104:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265554.105111:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789265554.106895:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265554.106908:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789265554.107490:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265554.107498:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789265554.108189:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265554.108988:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789265554.108997:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789265554.109586:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789265554.109594:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789265554.139082:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265554.139317:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789265554.139323:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789265554.140880:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789265554.140898:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789265554.145490:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265554.145701:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265554.145707:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789265554.146272:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265554.146280:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789265554.146913:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265554.147189:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265554.147194:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789265554.147852:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265554.147859:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789265554.148750:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265554.148950:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265554.148956:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789265554.149591:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265554.149598:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789265554.171547:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265554.171856:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265554.171863:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789265554.174859:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265554.174876:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789265554.177692:0:14288:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265554.177712:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789265554.179131:0:14288:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789265554.179157:0:14288:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789265554.179164:0:14288:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789265554.179304:0:14288:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265554.179543:0:14288:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.143@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789265554.179552:0:14288:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265554.179554:0:14288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265554.179555:0:14288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265554.179556:0:14288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265554.179557:0:14288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265554.179559:0:14288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265554.179560:0:14288:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265554.179561:0:14288:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265554.179563:0:14288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265554.179564:0:14288:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265554.179566:0:14288:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789265554.179569:0:14288:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265554.179569:0:14288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265554.179570:0:14288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265554.179571:0:14288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265554.179572:0:14288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265554.179573:0:14288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265554.179573:0:14288:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265554.179574:0:14288:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265554.179575:0:14288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265554.179576:0:14288:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265554.179604:0:14288:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789265554.179637:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782016:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265554.179715:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.179770:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409a7ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.179840:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553782016 00000100:00100000:2.0:1789265554.179849:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553782016 00000100:00100000:2.0:1789265554.179898:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265554.179908:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a82e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+5:14288:x1876180553782016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265554.179965:0:14301:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789265554.179969:0:14301:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789265554.179973:0:14301:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789265554.180469:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789265554.180911:0:14301:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789265554.182484:0:14323:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789265554.182500:0:14323:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789265554.182503:0:14323:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789265554.182555:0:14323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789265554.182949:0:14301:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789265554.182961:0:14301:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789265554.200323:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a82e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+5:14288:x1876180553782016:12345-0@lo:253:mount.lustre.0 Request processed in 20406us (20597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265554.200389:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265554.200490:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265554.200506:0:14288:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789265554.200509:0:14288:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265554.200511:0:14288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265554.200512:0:14288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265554.200513:0:14288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265554.200515:0:14288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265554.200516:0:14288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265554.200518:0:14288:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265554.200519:0:14288:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265554.200532:0:14288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265554.200533:0:14288:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265554.200558:0:14288:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92543bbd7000 from lustre-MDT0000 10000000:01000000:1.0:1789265554.200585:0:14288:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789265554.200589:0:14288:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789265554.200593:0:14288:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92543d3b8000 10000000:01000000:1.0:1789265554.200597:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265554.200605:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92543d3b8000 from 1 10000000:01000000:1.0:1789265554.200608:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265554.200648:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.200659:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.200686:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265554.200707:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265554.200750:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.200903:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540327d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.202713:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553782144 00000100:00100000:2.0:1789265554.202731:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553782144 00000100:00100000:2.0:1789265554.202853:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265554.202865:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+5:14288:x1876180553782144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265554.202882:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265554.202905:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136800/0x8e12577ef8190458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef8190451 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.202959:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136800/0x8e12577ef8190458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef8190451 expref: 6 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.203047:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136800/0x8e12577ef8190458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190451 expref: 6 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.203058:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136800, rc 0) 00000100:00100000:2.0:1789265554.203148:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+6:14288:x1876180553782144:12345-0@lo:101:mount.lustre.0 Request processed in 284us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.203155:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265554.203260:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265554.203280:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.203290:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265554.203384:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265554.203421:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.204387:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540327d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265554.204487:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553782272 00000100:00100000:3.0:1789265554.204496:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553782272 00000100:00100000:0.0:1789265554.204584:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265554.204595:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+6:14288:x1876180553782272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265554.204867:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+6:14288:x1876180553782272:12345-0@lo:501:mount.lustre.0 Request processed in 273us (1445us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265554.204874:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265554.205354:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782272:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789265554.205389:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789265554.205406:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.205416:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265554.205426:0:14288:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92543bbd7000 10000000:01000000:1.0:1789265554.205431:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265554.205447:0:14288:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92543bbd7000 10000000:01000000:1.0:1789265554.205450:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789265554.205454:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92543bbd7000 from 1 10000000:01000000:1.0:1789265554.205456:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789265554.205489:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef819045f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.205496:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef819045f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.205506:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef819045f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265554.205532:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265554.205571:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.205594:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540327d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265554.205662:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553782400 00000100:00100000:0.0:1789265554.205668:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553782400 00000100:00100000:0.0:1789265554.205694:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265554.205700:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+6:14288:x1876180553782400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265554.205709:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265554.205722:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441994a00/0x8e12577ef8190466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef819045f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.205741:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441994a00/0x8e12577ef8190466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef819045f expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.205759:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441994a00/0x8e12577ef8190466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef819045f expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.205767:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994a00, rc 0) 00000100:00100000:0.0:1789265554.205936:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+7:14288:x1876180553782400:12345-0@lo:101:mount.lustre.0 Request processed in 234us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.206156:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265554.206368:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265554.206384:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef819045f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190466 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.206395:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef819045f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190466 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265554.206409:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789265554.206419:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef819045f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190466 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.206427:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92543bc5e200/0x8e12577ef819045f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190466 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265554.206446:0:14288:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789265554.206450:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265554.206455:0:14288:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92543bbd7000 10000000:01000000:1.0:1789265554.206458:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789265554.206461:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789265554.206463:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265554.206483:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e600/0x8e12577ef819046d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.206491:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92543bc5e600/0x8e12577ef819046d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.206500:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92543bc5e600/0x8e12577ef819046d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265554.206515:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265554.206558:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.206795:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540327d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.206863:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553782528 00000100:00100000:2.0:1789265554.206870:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553782528 00000100:00100000:2.0:1789265554.206896:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265554.206904:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+7:14288:x1876180553782528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265554.206913:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265554.207283:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136e00/0x8e12577ef8190474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef819046d expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.207306:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136e00/0x8e12577ef8190474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef819046d expref: 8 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.207325:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136e00/0x8e12577ef8190474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef819046d expref: 8 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.207376:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136e00, rc 0) 00000100:00100000:2.0:1789265554.207426:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+8:14288:x1876180553782528:12345-0@lo:101:mount.lustre.0 Request processed in 522us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.207433:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265554.207536:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265554.207551:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92543bc5e600/0x8e12577ef819046d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190474 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.207559:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92543bc5e600/0x8e12577ef819046d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190474 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265554.207616:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265554.207644:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.207680:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540327d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.207731:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553782656 00000100:00100000:2.0:1789265554.207735:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553782656 00000100:00100000:2.0:1789265554.207755:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265554.207761:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+8:14288:x1876180553782656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265554.208696:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+9:14288:x1876180553782656:12345-0@lo:501:mount.lustre.0 Request processed in 932us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.208705:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265554.209315:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265554.209471:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265554.209539:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.209576:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540327d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.209628:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553782784 00000100:00100000:2.0:1789265554.209634:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553782784 00000100:00100000:2.0:1789265554.209678:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265554.209686:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+9:14288:x1876180553782784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265554.210302:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+9:14288:x1876180553782784:12345-0@lo:503:mount.lustre.0 Request processed in 611us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.210311:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265554.210472:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553782784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265554.211728:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14324:1876180553782912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265554.211816:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.211906:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a487d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265554.212175:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553782912 00000100:00100000:3.0:1789265554.212184:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553782912 00000100:00100000:3.0:1789265554.212264:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265554.212275:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+9:14324:x1876180553782912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265554.212667:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+9:14324:x1876180553782912:12345-0@lo:502:llog_process_th.0 Request processed in 393us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265554.212676:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265554.212787:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14324:1876180553782912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265554.212818:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265554.212830:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265554.212832:0:14324:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789265554.212838:0:14324:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789265554.212841:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265554.212855:0:14324:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff925402d74d28) 00000020:00000080:0.0:1789265554.212875:0:14324:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789265554.212882:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789265554.212980:0:14324:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789265554.212989:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef8190482 00000020:00000080:0.0:1789265554.213227:0:14324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789265554.213232:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265554.213236:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265554.213237:0:14324:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789265554.213240:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265554.213243:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265554.213244:0:14324:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789265554.213248:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265554.213263:0:14324:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9254374c4d28) 00000020:00000080:0.0:1789265554.213275:0:14324:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789265554.213281:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789265554.213287:0:14324:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789265554.213290:0:14324:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789265554.213296:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789265554.213378:0:14324:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92543bbd7000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789265554.213391:0:14324:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9254374c19b8) 00000020:00000080:0.0:1789265554.213400:0:14324:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789265554.213453:0:14324:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789265554.213458:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef8190497 00000020:00000080:0.0:1789265554.213562:0:14324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789265554.213568:0:14324:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789265554.213572:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8e12577ef819049e 00080000:01000000:0.0:1789265554.213577:0:14324:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789265554.213580:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef81904a5 00010000:00010000:3.0:1789265554.281852:0:14324:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789265554.282542:0:14324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789265554.282711:0:14324:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789265554.283513:0:14324:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff92543d3bcd28) 00000020:00000080:3.0:1789265554.283549:0:14324:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789265554.283620:0:14324:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789265554.283627:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef81904b3 00000020:00000080:2.0:1789265554.285362:0:14324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789265554.295157:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8e12577ef81904ba 00000020:00000080:3.0:1789265554.295587:0:14324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789265554.295599:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265554.295606:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.295608:0:14324:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789265554.295612:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265554.295619:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.295620:0:14324:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789265554.295625:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789265554.295663:0:14324:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789265554.295681:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265554.295685:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.295686:0:14324:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789265554.295689:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265554.295691:0:14324:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789265554.295692:0:14324:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265554.295694:0:14324:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265554.295695:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265554.295697:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.295699:0:14324:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265554.295701:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265554.295710:0:14324:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789265554.295713:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.295714:0:14324:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789265554.295719:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265554.295724:0:14324:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.143@tcp to nid 0x20000c0a8cc8f (192.168.204.143@tcp) 00000020:01000000:3.0:1789265554.295750:0:14324:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789265554.295753:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265554.295767:0:14324:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92543d3b99b8) 00000020:00000080:3.0:1789265554.295781:0:14324:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789265554.295785:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265554.295842:0:14324:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789265554.295848:0:14324:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789265554.295853:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef81904c8 00010000:00080000:3.0:1789265554.295883:0:14324:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9254051e6800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:3.0:1789265554.297272:0:14324:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789265554.297807:0:14324:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265554.297854:0:14324:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789265554.299766:0:14324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265554.299827:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789265554.299911:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789265554.300752:0:14328:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789265554.300758:0:14328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789265554.301703:0:14324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265554.301719:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265554.301754:0:14324:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789265554.301778:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef81904cf 00000100:00080000:3.0:1789265554.301791:0:14324:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265554.301797:0:14324:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9254051e6800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1789265554.301836:0:14324:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9df80 x1876180553783040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265554.301926:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553783040:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789265554.301994:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180553783040 offset 0 length 520: 4 00000100:00080000:3.0:1789265554.302177:0:14324:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789265554.302257:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265554.302272:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.302274:0:14324:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789265554.302278:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265554.302281:0:14324:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789265554.302283:0:14324:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265554.302285:0:14324:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265554.302286:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265554.302289:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.302290:0:14324:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265554.302293:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265554.302297:0:14324:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789265554.302300:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.302302:0:14324:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789265554.302305:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265554.302309:0:14324:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.143@tcp to nid 0x20000c0a8cc8f (192.168.204.143@tcp) 00000020:01000000:3.0:1789265554.302357:0:14324:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789265554.302361:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265554.302375:0:14324:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff92543d3bb370) 00000020:00000080:3.0:1789265554.302389:0:14324:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789265554.302394:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265554.302471:0:14324:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789265554.302477:0:14324:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789265554.302483:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e12577ef81904dd 00010000:00080000:3.0:1789265554.302511:0:14324:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92543b68c800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:3.0:1789265554.302731:0:14324:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789265554.303698:0:14324:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265554.303749:0:14324:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789265554.306129:0:14324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265554.306211:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789265554.306305:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789265554.307866:0:14330:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789265554.307874:0:14330:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789265554.309265:0:14324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265554.309280:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789265554.309316:0:14324:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789265554.309367:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef81904e4 00000100:00080000:1.0:1789265554.309379:0:14324:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265554.309385:0:14324:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92543b68c800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1789265554.309433:0:14324:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92543be42300 x1876180553783168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265554.309458:0:14324:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789265554.309529:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265554.309534:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265554.309536:0:14324:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789265554.309539:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265554.309543:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265554.309544:0:14324:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265554.309547:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265554.309549:0:14324:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789265554.309561:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265554.309564:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265554.309566:0:14324:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789265554.309568:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265554.309570:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265554.309572:0:14324:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789265554.309575:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789265554.309608:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14324:1876180553783296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265554.309690:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.309742:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540327d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.310217:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553783168:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789265554.310252:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180553783168 offset 0 length 520: 4 00000100:00100000:0.0:1789265554.311061:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553783296 00000100:00100000:0.0:1789265554.311072:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553783296 00000100:00100000:0.0:1789265554.311160:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265554.311170:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+9:14324:x1876180553783296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265554.311604:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+9:14324:x1876180553783296:12345-0@lo:502:llog_process_th.0 Request processed in 433us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.311612:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265554.312141:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14324:1876180553783296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265554.312178:0:14324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265554.312186:0:14324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265554.312188:0:14324:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789265554.312193:0:14324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789265554.312469:0:14288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789265554.312489:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789265554.312508:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5e600/0x8e12577ef819046d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190474 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.312540:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92543bc5e600/0x8e12577ef819046d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190474 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265554.312549:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92543bbd7000 from 1 10000000:01000000:3.0:1789265554.312552:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265554.312643:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.312652:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.312662:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265554.312684:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265554.312749:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.313258:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c0c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.313447:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553783424 00000100:00100000:2.0:1789265554.313455:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553783424 00000100:00100000:2.0:1789265554.313493:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265554.313502:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+9:14288:x1876180553783424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265554.313517:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265554.313546:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef81904eb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.313570:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef81904eb expref: 10 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.313581:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81904eb expref: 10 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.313588:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137800, rc 0) 00000100:00100000:2.0:1789265554.313648:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+10:14288:x1876180553783424:12345-0@lo:101:mount.lustre.0 Request processed in 148us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.313656:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265554.313745:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265554.313760:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.313770:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265554.314716:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783552:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789265554.314781:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.314854:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c0c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.315089:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553783552 00000100:00100000:2.0:1789265554.315096:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553783552 00000100:00100000:2.0:1789265554.315130:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265554.315139:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+10:14288:x1876180553783552:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789265554.315160:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789265554.315167:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789265554.315249:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+10:14288:x1876180553783552:12345-0@lo:256:mount.lustre.0 Request processed in 111us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.315267:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265554.315368:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783552:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789265554.316291:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265554.316305:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.316317:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265554.316326:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92543bbd7000 from 1 10000000:01000000:3.0:1789265554.316328:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265554.316457:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.316464:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.316475:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265554.316497:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265554.316558:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.316715:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c0c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265554.316868:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553783680 00000100:00100000:0.0:1789265554.316876:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553783680 00000100:00100000:2.0:1789265554.316937:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265554.316949:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+10:14288:x1876180553783680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265554.316963:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265554.316989:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef81904f9 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.317013:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.317025:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.317034:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136600, rc 0) 00000100:00100000:2.0:1789265554.317087:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14288:x1876180553783680:12345-0@lo:101:mount.lustre.0 Request processed in 140us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.317095:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265554.317239:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265554.317254:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.317263:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265554.317376:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265554.317401:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.317417:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c0c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.317552:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553783808 00000100:00100000:2.0:1789265554.317556:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553783808 00000100:00100000:2.0:1789265554.317575:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265554.317581:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14288:x1876180553783808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265554.318204:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14288:x1876180553783808:12345-0@lo:501:mount.lustre.0 Request processed in 621us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.318212:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265554.318305:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265554.318376:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265554.318418:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.318435:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c0c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.318488:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553783936 00000100:00100000:2.0:1789265554.318492:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553783936 00000100:00100000:2.0:1789265554.318513:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265554.318540:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14288:x1876180553783936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265554.318698:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14288:x1876180553783936:12345-0@lo:503:mount.lustre.0 Request processed in 159us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265554.318796:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553783936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265554.319075:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14332:1876180553784064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265554.319111:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.319121:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.319285:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265554.319314:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553784064 00000100:00100000:2.0:1789265554.319319:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553784064 00000100:00100000:2.0:1789265554.319375:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265554.319383:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14332:x1876180553784064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265554.319601:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14332:x1876180553784064:12345-0@lo:502:llog_process_th.0 Request processed in 219us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.319609:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265554.319849:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14332:1876180553784064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265554.319875:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265554.319884:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.319886:0:14332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265554.319894:0:14332:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92543bbd7000 00000020:00000080:3.0:1789265554.319898:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265554.319906:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265554.319909:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.319910:0:14332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789265554.320040:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265554.320046:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.320047:0:14332:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265554.320052:0:14332:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92543bbd7000 00000020:00000080:3.0:1789265554.320054:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265554.320129:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265554.320133:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.320134:0:14332:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789265554.320137:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265554.320139:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.320141:0:14332:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265554.320144:0:14332:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92543bbd7000 00000020:00000080:3.0:1789265554.320146:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265554.320187:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14332:1876180553784192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265554.320229:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.320256:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.320833:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553784192 00000100:00100000:2.0:1789265554.320842:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553784192 00000100:00100000:2.0:1789265554.320886:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265554.320895:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14332:x1876180553784192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265554.321263:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14332:x1876180553784192:12345-0@lo:502:llog_process_th.0 Request processed in 368us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.321272:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265554.321418:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14332:1876180553784192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265554.321446:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265554.321454:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265554.321456:0:14332:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789265554.321459:0:14332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789265554.322063:0:14288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789265554.322092:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265554.322102:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.322115:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265554.322158:0:14288:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265554.322170:0:14288:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92543bbd7000 10000000:01000000:2.0:1789265554.322174:0:14288:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92543bbd7000 10000000:01000000:2.0:1789265554.322178:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265554.322184:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92543bbd7000 from 1 10000000:01000000:2.0:1789265554.322187:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265554.322221:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef8190507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.322228:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef8190507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.322237:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef8190507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265554.322258:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553784320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265554.322304:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.322363:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a487600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265554.322464:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553784320 00000100:00100000:3.0:1789265554.322470:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553784320 00000100:00100000:3.0:1789265554.322509:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265554.322528:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14288:x1876180553784320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265554.322541:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265554.322557:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441885e00/0x8e12577ef819050e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef8190507 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.322579:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885e00/0x8e12577ef819050e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef8190507 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.322590:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441885e00/0x8e12577ef819050e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190507 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.322610:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885e00, rc 0) 00000100:00100000:3.0:1789265554.322647:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14288:x1876180553784320:12345-0@lo:101:mount.lustre.0 Request processed in 131us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265554.322654:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265554.323880:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553784320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265554.323904:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef8190507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819050e expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.323916:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef8190507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef819050e expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265554.324211:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553784448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265554.324261:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.324298:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a487600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265554.324455:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553784448 00000100:00100000:0.0:1789265554.324461:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553784448 00000100:00100000:0.0:1789265554.324499:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265554.324507:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14288:x1876180553784448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265554.325106:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14288:x1876180553784448:12345-0@lo:501:mount.lustre.0 Request processed in 596us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.325125:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265554.328510:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553784448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265554.328587:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553784576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265554.328811:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.328859:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540a487600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.328893:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553784576 00000100:00100000:2.0:1789265554.328900:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553784576 00000100:00100000:2.0:1789265554.328954:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265554.328963:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14288:x1876180553784576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265554.329218:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14288:x1876180553784576:12345-0@lo:503:mount.lustre.0 Request processed in 255us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.329228:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265554.330051:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553784576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265554.338378:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14335:1876180553784704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265554.338467:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.338509:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b9d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265554.338828:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553784704 00000100:00100000:0.0:1789265554.338835:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553784704 00000100:00100000:0.0:1789265554.338892:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265554.338902:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14335:x1876180553784704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265554.339259:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14335:x1876180553784704:12345-0@lo:502:llog_process_th.0 Request processed in 358us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.339268:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265554.339555:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14335:1876180553784704:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789265554.339614:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789265554.339629:0:14335:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9254373c3370) 00000020:00000080:1.0:1789265554.339647:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789265554.339737:0:14335:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92543bbd7000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265554.339741:0:14335:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92543bbd7000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265554.339744:0:14335:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92543bbd7000 4 00010000:00080000:1.0:1789265554.339774:0:14335:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9254093fc800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:1.0:1789265554.345799:0:14335:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789265554.347328:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789265554.347389:0:14335:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265554.347405:0:14335:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8e12577ef819051c 00000100:00080000:2.0:1789265554.347416:0:14335:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265554.347422:0:14335:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9254093fc800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:2.0:1789265554.347475:0:14335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925437482680 x1876180553784832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265554.347513:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553784832:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265554.347604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.347691:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553784832 00000100:00100000:2.0:1789265554.347698:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553784832 00000100:00100000:2.0:1789265554.347729:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265554.347736:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876180553784832:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265554.347787:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876180553784832:12345-0@lo:38:llog_process_th.0 Request processed in 50us (183us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789265554.347794:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265554.347839:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265554.347846:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9254093fc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265554.347871:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789265554.347875:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553784832:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789265554.347894:0:14335:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789265554.350746:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14335:1876180553784960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265554.350837:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.350882:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553784960 00000100:00100000:2.0:1789265554.350891:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553784960 00000100:00100000:2.0:1789265554.350945:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265554.350956:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14335:x1876180553784960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265554.352374:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14335:x1876180553784960:12345-0@lo:502:llog_process_th.0 Request processed in 1412us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.352387:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265554.352466:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080c5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265554.352494:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14335:1876180553784960:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789265554.354236:0:14335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789265554.354558:0:14288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789265554.354599:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265554.354624:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef8190507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819050e expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265554.354637:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403137400/0x8e12577ef8190507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819050e expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265554.354700:0:14288:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265554.354702:0:14288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265554.354704:0:14288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265554.354705:0:14288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265554.354706:0:14288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265554.354708:0:14288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265554.354709:0:14288:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265554.354710:0:14288:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265554.354713:0:14288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265554.354714:0:14288:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265554.354719:0:14288:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789265554.354721:0:14288:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265554.354722:0:14288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265554.354723:0:14288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265554.354725:0:14288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265554.354726:0:14288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265554.354726:0:14288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265554.354728:0:14288:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265554.354729:0:14288:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265554.354730:0:14288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265554.354730:0:14288:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265554.354758:0:14288:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789265554.354779:0:14288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553785088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265554.354848:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.354891:0:14288:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080de900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265554.355105:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553785088 00000100:00100000:0.0:1789265554.355113:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553785088 00000100:00100000:0.0:1789265554.355159:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265554.355169:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14288:x1876180553785088:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265554.355195:0:14298:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789265554.355209:0:14298:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789265554.419910:0:14298:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265554.419976:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789265554.422253:0:14322:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265554.422264:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265554.422288:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.422308:0:14322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81904eb expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.422316:0:14322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.422402:0:14322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef81904eb expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.422417:0:14322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef81904eb expref: 12 pid: 14298 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265554.422432:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14322:1876180553785216:0@lo:104: 00000100:00100000:2.0:1789265554.422508:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.422563:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080c5780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265554.422663:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553785216 00000100:00100000:0.0:1789265554.422673:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553785216 00000100:00100000:0.0:1789265554.422729:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265554.422739:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:14322:x1876180553785216:12345-0@lo:104: 00010000:00010000:0.0:1789265554.422751:0:14289:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.422810:0:14289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265554.422816:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:14322:x1876180553785216:12345-0@lo:104: Request processed in 80us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.422823:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789265554.422958:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265554.422975:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.422982:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1789265554.422986:0:14295:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.422995:0:14295:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265554.423003:0:14295:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265554.423009:0:14295:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265554.423049:0:14295:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.423056:0:14295:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265554.423084:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.423098:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925441884800/0x8e12577ef81904eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81904f2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.423116:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.423118:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.423120:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265554.423144:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265554.423155:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3306:1876180553785344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265554.423184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.423228:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14322:1876180553785216:0@lo:104: 00010000:00010000:2.0:1789265554.423246:0:14322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265554.423386:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553785344 00000100:00100000:0.0:1789265554.423392:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553785344 00010000:00010000:0.0:1789265554.423409:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef81904eb expref: 13 pid: 14298 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265554.423437:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265554.423444:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+13:3306:x1876180553785344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265554.423454:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265554.423459:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef81904eb expref: 13 pid: 14298 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423469:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef81904eb expref: 13 pid: 14298 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423482:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137800/0x8e12577ef81904f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef81904eb expref: 13 pid: 14298 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423496:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423504:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265554.423530:0:14291:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001267771s 00010000:00010000:0.0:1789265554.423535:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423541:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423548:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423562:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423568:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265554.423572:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423579:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423602:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265554.423612:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265554.423642:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:3306:x1876180553785344:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.423649:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789265554.423714:0:14322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.423721:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265554.423728:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137000/0x8e12577ef8190523 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265554.423896:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3306:1876180553785344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265554.429870:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14288:x1876180553785088:12345-0@lo:253:mount.lustre.0 Request processed in 74687us (75006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.429887:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789265554.430049:0:14288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14288:1876180553785088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265554.430068:0:14288:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789265554.430071:0:14288:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265554.430073:0:14288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265554.430093:0:14288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265554.430094:0:14288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265554.430096:0:14288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265554.430097:0:14288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265554.430099:0:14288:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265554.430100:0:14288:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265554.430102:0:14288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265554.430103:0:14288:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265554.430120:0:14288:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789265554.435636:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265554.435816:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265554.436110:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265554.436270:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265554.436824:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265554.437576:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265554.438541:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265554.438715:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265554.439057:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265554.439303:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265554.439748:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265554.439923:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789265554.467398:0:14288:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789265554.467892:0:14288:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789265554.467972:0:14344:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789265554.467976:0:14344:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789265554.468544:0:14345:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789265554.468751:0:14345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265554.471828:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789265554.471942:0:14345:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789265554.471948:0:14345:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1789265554.473650:0:14288:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789265554.473783:0:14288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789265554.474213:0:14288:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789265554.474221:0:14288:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789265554.474383:0:14288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265554.475968:0:14288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789265554.476742:0:14288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789265554.476784:0:14288:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789265554.477531:0:14288:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1789265554.478788:0:14288:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789265554.484797:0:14288:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789265554.508388:0:14288:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789265554.508432:0:14288:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9e5bc1c5b988 00100000:10000000:1.0:1789265554.508441:0:14288:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789265554.509371:0:14288:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265554.509389:0:14288:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265554.509404:0:14288:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789265554.509441:0:14288:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789265555.107747:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265555.422575:0:14340:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265555.422587:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265555.424373:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789265555.424597:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1789265555.742475:0:14303:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265555.742484:0:14303:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92543bbd7000 from 6 10000000:01000000:0.0:1789265555.742500:0:14303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265555.742700:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.742736:0:14303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.742748:0:14303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265555.742777:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553785472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265555.746044:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265555.746266:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553785472 00000100:00100000:2.0:1789265555.746276:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553785472 00000100:00100000:2.0:1789265555.746370:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265555.746382:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14303:x1876180553785472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265555.746402:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265555.746424:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef819052a expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265555.746473:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef819052a expref: 12 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265555.746484:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef819052a expref: 12 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265555.746503:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137800, rc 0) 00000100:00100000:2.0:1789265555.746555:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14303:x1876180553785472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265555.746562:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265555.747730:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540715bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265555.747772:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553785472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265555.747795:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.747806:0:14303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265555.748074:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553785600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265555.748135:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265555.748248:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553785600 00000100:00100000:2.0:1789265555.748255:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553785600 00000100:00100000:2.0:1789265555.748389:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265555.748398:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14303:x1876180553785600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789265555.748418:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265555.748441:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265555.748444:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789265555.748558:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14303:x1876180553785600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265555.748566:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265555.755738:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540715bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265555.755815:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553785600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265555.755896:0:14303:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265555.755907:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.755920:0:14303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265556.127004:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265556.446639:0:14340:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265556.446651:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265556.447813:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789265556.447884:0:14340:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265556.447916:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1789265557.150770:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265558.175661:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265559.199105:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265559.456439:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265559.456447:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265559.456450:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265559.456458:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265559.456461:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789265559.456464:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789265559.456468:0:8:0:(import.c:65:import_set_state_nolock()) ffff9254093fc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265559.456479:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9254093fc800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1789265559.456515:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9d880 x1876180553785856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265559.456570:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553785728:0@lo:400:kworker.0 00000100:00100000:3.0:1789265559.456641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265559.456710:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553785728 00000100:00100000:3.0:1789265559.456719:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553785728 00000100:00100000:3.0:1789265559.456759:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265559.456767:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:3304:x1876180553785728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265559.456816:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:3304:x1876180553785728:12345-0@lo:400:kworker.0 Request processed in 49us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265559.456824:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265559.456867:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553785728:0@lo:400:kworker.0 00000100:00100000:3.0:1789265559.458485:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553785856:0@lo:38:kworker.0 00000100:00100000:3.0:1789265559.458565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265559.461988:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553785856 00000100:00100000:2.0:1789265559.462002:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553785856 00000100:00100000:2.0:1789265559.462049:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265559.462057:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876180553785856:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789265559.462083:0:14308:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:2.0:1789265559.462120:0:14308:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8e12577ef8190538 00000004:00100000:2.0:1789265559.462144:0:14308:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265559.462275:0:14308:0:(import.c:65:import_set_state_nolock()) ffff92540a812800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265559.462388:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876180553785856:12345-0@lo:38:kworker.0 Request processed in 330us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265559.462396:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265559.462463:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff925441a9d880 x1876180553785856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265559.462479:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789265559.462488:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789265559.462571:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265559.462575:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9254093fc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265559.462582:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876180553785856:0@lo:38:kworker.0 00000001:02000400:2.0:1789265559.495872:0:14588:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265560.222590:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265561.250042:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265562.278914:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789265562.629584:0:14739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea87feb40 20000000:00000080:3.0:1789265562.629667:0:14739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92540485f800 uarg=0000000000000000 20000000:01000000:3.0:1789265562.629704:0:14739:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789265562.629716:0:14739:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789265562.629721:0:14739:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789265562.636898:0:14740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789265562.637097:0:14739:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789265562.648512:0:14739:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789265562.648778:0:14739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.648801:0:14739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.648810:0:14739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.648856:0:14739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.648869:0:14739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 11 pid: 14298 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.649041:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14739:1876180553785984:0@lo:104: 00000100:00100000:2.0:1789265562.649110:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265562.649172:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080c50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265562.649246:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553785984 00000100:00100000:1.0:1789265562.649255:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553785984 00000100:00100000:1.0:1789265562.649311:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265562.649320:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:14739:x1876180553785984:12345-0@lo:104: 00010000:00010000:1.0:1789265562.649374:0:14290:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.649441:0:14290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265562.649447:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:14739:x1876180553785984:12345-0@lo:104: Request processed in 129us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265562.649454:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789265562.649734:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265562.649743:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.649752:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1789265562.649755:0:14294:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.649765:0:14294:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265562.649772:0:14294:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265562.649778:0:14294:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265562.650246:0:14294:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.650254:0:14294:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265562.650301:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.650309:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925441885000/0x8e12577ef81904f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef8190500 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.650379:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265562.650381:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265562.650398:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265562.650472:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553786112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265562.650538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265562.650755:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553786112 00000100:00100000:3.0:1789265562.650764:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553786112 00010000:00010000:3.0:1789265562.650795:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 12 pid: 14298 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.650992:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14739:1876180553785984:0@lo:104: 00010000:00010000:2.0:1789265562.651019:0:14739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265562.651076:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265562.651087:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:3305:x1876180553786112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265562.651101:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265562.651107:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 12 pid: 14298 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651127:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 12 pid: 14298 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651145:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136600/0x8e12577ef8190500 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef81904f9 expref: 12 pid: 14298 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651162:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651170:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651185:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651193:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651199:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651220:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651225:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265562.651229:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651237:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651257:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.651269:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265562.651368:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:3305:x1876180553786112:12345-0@lo:103:ldlm_bl.0 Request processed in 245us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.651377:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789265562.651434:0:14739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.651443:0:14739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.651450:0:14739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136200/0x8e12577ef819053f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265562.652752:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553786112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265563.307452:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265564.319235:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265564.575757:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265564.575765:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265564.575768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265564.575771:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265564.575864:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3306:1876180553786240:0@lo:400:kworker.0 00000100:00100000:2.0:1789265564.575952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265564.576008:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265564.576014:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553786368:0@lo:400:kworker.0 00000100:00100000:2.0:1789265564.576042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265564.576091:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553786240 00000100:00100000:2.0:1789265564.576098:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553786240 00000100:00100000:2.0:1789265564.576142:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265564.576152:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:3306:x1876180553786240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265564.576201:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:3306:x1876180553786240:12345-0@lo:400:kworker.0 Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265564.576208:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265564.576247:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553786368 00000100:00100000:2.0:1789265564.576251:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553786368 00000100:00100000:2.0:1789265564.576278:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265564.576284:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553786368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265564.576315:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553786368:12345-0@lo:400:kworker.0 Request processed in 32us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265564.576365:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789265564.576406:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff925437480700 x1876180553786368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265564.576421:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553786368:0@lo:400:kworker.0 00000100:00100000:2.0:1789265564.576432:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3306:1876180553786240:0@lo:400:kworker.0 00000100:00100000:0.0:1789265564.577018:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265554/real 1789265554] req@ffff92543be42300 x1876180553783168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265564.577039:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92543be42300 x1876180553783168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265564.577049:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265554/real 1789265554] req@ffff925441a9df80 x1876180553783040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265564.577061:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff925441a9df80 x1876180553783040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265564.577073:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265564.577091:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265564.577095:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553783168:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789265564.577099:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9254051e6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265564.577104:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265564.577116:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553783040:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789265564.577690:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265564.577695:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789265564.577698:0:37:0:(import.c:65:import_set_state_nolock()) ffff9254051e6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265564.577704:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1789265564.577707:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789265564.577712:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9254051e6800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1789265564.577805:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9e680 x1876180553786496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265564.577824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265564.577833:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265564.577835:0:37:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265564.577838:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1789265564.577840:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789265564.577844:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92543b68c800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1789265564.577856:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9f800 x1876180553786624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265564.579802:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553786496:0@lo:8:kworker.0 00000400:00000100:0.0:1789265564.579867:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180553786496 offset 0 length 520: 4 00000100:00100000:0.0:1789265564.579911:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553786624:0@lo:8:kworker.0 00000400:00000100:0.0:1789265564.580087:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180553786624 offset 0 length 520: 4 10000000:01000000:1.0:1789265564.639405:0:14303:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265564.639413:0:14303:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92543bbd7000 from 10 10000000:01000000:1.0:1789265564.639417:0:14303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265564.639469:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265564.639481:0:14303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265564.639492:0:14303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265564.639518:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553786752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265564.639595:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265564.639641:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265564.639818:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553786752 00000100:00100000:3.0:1789265564.639826:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553786752 00000100:00100000:3.0:1789265564.639889:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265564.639899:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+11:14303:x1876180553786752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265564.639913:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265564.639928:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef8190546 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.639952:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef8190546 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.639964:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190546 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.639973:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885000, rc 0) 00000100:00100000:3.0:1789265564.640119:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14303:x1876180553786752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265564.640126:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265564.640197:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553786752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265564.640221:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265564.640231:0:14303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265564.640288:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553786880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265564.640329:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265564.640382:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265564.640408:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553786880 00000100:00100000:2.0:1789265564.640414:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553786880 00000100:00100000:2.0:1789265564.640452:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265564.640460:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14303:x1876180553786880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265564.640720:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14303:x1876180553786880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265564.640727:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265564.641063:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553786880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265564.641100:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553787008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265564.641140:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265564.641166:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265564.641219:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553787008 00000100:00100000:3.0:1789265564.641225:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553787008 00000100:00100000:3.0:1789265564.641259:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265564.641273:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14303:x1876180553787008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265564.641448:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14303:x1876180553787008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265564.641455:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265564.641493:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553787008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265564.642172:0:14816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789265564.642244:0:14303:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789265564.642265:0:14303:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265564.642275:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.642285:0:14303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265565.342573:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265566.366933:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265566.688053:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265567.390614:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265567.551380:0:14989:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265567.551386:0:14989:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789265567.551567:0:14989:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff925404c95800 00000020:01000004:3.0:1789265567.551591:0:14989:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789265567.551609:0:14989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789265567.551631:0:14989:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff925402d54d28) 00000020:00000080:3.0:1789265567.551650:0:14989:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789265567.574469:0:14989:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789265567.574820:0:14989:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789265567.575676:0:14989:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789265567.576570:0:14989:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789265567.577085:0:14989:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789265567.577721:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 677: rc = 0 00100000:10000000:3.0:1789265567.578031:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 677: rc = 0 00100000:10000000:3.0:1789265567.578135:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 677: rc = 0 00100000:10000000:3.0:1789265567.578718:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 314: rc = 0 00100000:10000000:3.0:1789265567.579306:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 314: rc = 0 00100000:10000000:3.0:1789265567.580023:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 314: rc = 0 00100000:10000000:3.0:1789265567.580323:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 314: rc = 0 00100000:10000000:3.0:1789265567.580713:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 314: rc = 0 00100000:10000000:3.0:1789265567.581223:0:14989:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 314: rc = 0 00000020:00000080:3.0:1789265567.582518:0:14989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789265567.582536:0:14989:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789265567.582551:0:14989:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8e12577ef819055b 00000020:01000004:3.0:1789265567.582562:0:14989:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789265567.582597:0:14989:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789265567.582601:0:14989:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789265567.582609:0:14989:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789265567.582614:0:14989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789265567.582631:0:14989:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff925402d53370) 00000020:00000080:3.0:1789265567.582644:0:14989:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789265567.590725:0:14989:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265567.591546:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789265567.591554:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789265567.595011:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265567.595031:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789265567.597434:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265567.597457:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789265567.600193:0:14989:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265567.601586:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789265567.601593:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789265567.603904:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789265567.604008:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789265567.621271:0:14989:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265567.621633:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265567.621734:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789265567.627728:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265567.627746:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789265567.628600:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265567.628609:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789265567.631322:0:14989:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265567.631922:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789265567.631929:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789265567.632822:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789265567.632830:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789265567.672792:0:14989:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265567.673131:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789265567.673137:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789265567.677228:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789265567.677242:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789265567.680501:0:14989:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789265567.680729:0:14989:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789265567.680738:0:14989:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789265567.703835:0:14989:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265567.703873:0:14989:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.143@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789265567.703878:0:14989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265567.703879:0:14989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265567.703881:0:14989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265567.703882:0:14989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265567.703883:0:14989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265567.703884:0:14989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265567.703886:0:14989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265567.703887:0:14989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265567.703889:0:14989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265567.703909:0:14989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789265567.703911:0:14989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265567.703913:0:14989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265567.703914:0:14989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265567.703930:0:14989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265567.703932:0:14989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265567.703933:0:14989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265567.703933:0:14989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265567.703934:0:14989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265567.703935:0:14989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265567.703970:0:14989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789265567.703990:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787136:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265567.704063:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265567.704118:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265567.704327:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553787136 00000100:00100000:2.0:1789265567.704364:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553787136 00000100:00100000:2.0:1789265567.704415:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265567.704424:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14989:x1876180553787136:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265567.704457:0:14300:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789265567.704460:0:14300:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789265567.704465:0:14300:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789265567.720253:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14989:x1876180553787136:12345-0@lo:253:mount.lustre.0 Request processed in 15819us (16179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.720277:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265567.720415:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265567.720430:0:14989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789265567.720434:0:14989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265567.720435:0:14989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265567.720437:0:14989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265567.720438:0:14989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265567.720439:0:14989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265567.720440:0:14989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265567.720442:0:14989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265567.720443:0:14989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265567.720444:0:14989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265567.720465:0:14989:0:(tgt_mount.c:101:server_register_mount()) register mount ffff925404c95800 from lustre-OST0000 10000000:01000000:3.0:1789265567.720488:0:14989:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789265567.720492:0:14989:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789265567.720498:0:14989:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92543d3b8000 local copy 00010000:00010000:3.0:1789265567.720509:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265567.720915:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265567.720954:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265567.721105:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265567.721156:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553787264 00000100:00100000:1.0:1789265567.721163:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553787264 00000100:00100000:1.0:1789265567.721252:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265567.721273:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14989:x1876180553787264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265567.721545:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14989:x1876180553787264:12345-0@lo:501:mount.lustre.0 Request processed in 284us (589us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265567.721554:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265567.721692:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787264:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789265567.721951:0:14989:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789265567.722125:0:14989:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789265567.722135:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.722146:0:14989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265567.722170:0:14989:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff925404c95800 10000000:01000000:2.0:1789265567.722175:0:14989:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789265567.722181:0:14989:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92543d3b8000 10000000:01000000:2.0:1789265567.722183:0:14989:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789265567.722193:0:14989:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92543d3b8000 from 1 10000000:01000000:2.0:1789265567.722196:0:14989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789265567.722224:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef8190569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.722232:0:14989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef8190569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.722241:0:14989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef8190569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265567.722412:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265567.722456:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265567.722530:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d87480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265567.722575:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553787392 00000100:00100000:0.0:1789265567.722581:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553787392 00000100:00100000:0.0:1789265567.722663:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265567.722672:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+12:14989:x1876180553787392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265567.722683:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265567.722697:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441994200/0x8e12577ef8190570 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef8190569 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.722731:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441994200/0x8e12577ef8190570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef8190569 expref: 13 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.722741:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441994200/0x8e12577ef8190570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190569 expref: 13 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.722750:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994200, rc 0) 00000100:00100000:0.0:1789265567.722916:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+13:14989:x1876180553787392:12345-0@lo:101:mount.lustre.0 Request processed in 245us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.722930:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265567.723059:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265567.723072:0:14989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef8190569 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190570 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.723081:0:14989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef8190569 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190570 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265567.723101:0:14989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789265567.723117:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef8190569 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190570 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.723125:0:14989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403137e00/0x8e12577ef8190569 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190570 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265567.723131:0:14989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789265567.723140:0:14989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265567.723145:0:14989:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789265567.723148:0:14989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789265567.723165:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef8190577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.723171:0:14989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef8190577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.723178:0:14989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef8190577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265567.723192:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265567.723219:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265567.723241:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d87480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265567.723353:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553787520 00000100:00100000:1.0:1789265567.723357:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553787520 00000100:00100000:1.0:1789265567.723389:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265567.723395:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+13:14989:x1876180553787520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265567.723402:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265567.723413:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92543bc5f200/0x8e12577ef819057e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef8190577 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.723427:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92543bc5f200/0x8e12577ef819057e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef8190577 expref: 14 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.723436:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92543bc5f200/0x8e12577ef819057e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190577 expref: 14 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.723443:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5f200, rc 0) 00000100:00100000:1.0:1789265567.723478:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553787520:12345-0@lo:101:mount.lustre.0 Request processed in 83us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265567.723484:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265567.723586:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265567.723596:0:14989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef8190577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819057e expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.723604:0:14989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef8190577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef819057e expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265567.724529:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789265567.725648:0:14989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265567.726000:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789265567.726040:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789265567.726070:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789265567.726109:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789265567.726137:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789265567.726161:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789265567.726245:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789265567.726253:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789265567.726389:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265567.726453:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265567.726490:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265567.726719:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553787648 00000100:00100000:1.0:1789265567.726727:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553787648 00000100:00100000:1.0:1789265567.726912:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265567.726929:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553787648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265567.727291:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553787648:12345-0@lo:501:mount.lustre.0 Request processed in 363us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265567.727299:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265567.727513:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265567.727551:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265567.727593:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265567.727618:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254210c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265567.727675:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553787776 00000100:00100000:1.0:1789265567.727680:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553787776 00000100:00100000:1.0:1789265567.727721:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265567.727728:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925421200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553787776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265567.728230:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925421200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553787776:12345-0@lo:503:mount.lustre.0 Request processed in 500us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265567.728238:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265567.728522:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787776:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265567.729446:0:14989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265567.729548:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265567.729605:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265567.729723:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265567.729925:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553787904 00000100:00100000:0.0:1789265567.729931:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553787904 00000100:00100000:0.0:1789265567.730024:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265567.730033:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925421201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553787904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265567.730275:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925421201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553787904:12345-0@lo:502:mount.lustre.0 Request processed in 242us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.730282:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265567.730377:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553787904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265567.730656:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789265567.730734:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789265567.730770:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789265567.730841:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789265567.730876:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789265567.730907:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789265567.730950:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789265567.730988:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789265567.731023:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789265567.731084:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789265567.731125:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789265567.731174:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789265567.731212:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265567.731275:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265567.731949:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265567.732027:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553788032 00000100:00100000:1.0:1789265567.732035:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553788032 00000100:00100000:1.0:1789265567.732076:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265567.732085:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553788032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265567.732297:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553788032:12345-0@lo:502:mount.lustre.0 Request processed in 213us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265567.732305:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265567.732418:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265567.732508:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789265567.732522:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789265567.733697:0:15003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265567.733774:0:15003:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789265567.733860:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265567.733863:0:15003:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789265567.733873:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265567.733888:0:15003:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9254373c19b8) 00000020:00000080:1.0:1789265567.733909:0:15003:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789265567.733913:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265567.733977:0:15003:0:(tgt_mount.c:153:server_get_mount()) get mount ffff925404c95800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789265567.733985:0:15003:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265567.734002:0:15003:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8e12577ef819058c 00010000:00010000:1.0:1789265567.738576:0:15003:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789265567.739129:0:15003:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1789265567.743441:0:15003:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789265567.745207:0:15003:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789265567.745221:0:15003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265567.745228:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265567.745230:0:15003:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789265567.745235:0:15003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789265567.745238:0:15003:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789265567.745239:0:15003:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265567.745240:0:15003:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265567.745242:0:15003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789265567.745244:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265567.745245:0:15003:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789265567.745247:0:15003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265567.745250:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265567.745251:0:15003:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265567.745253:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265567.745255:0:15003:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789265567.745272:0:15003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265567.745275:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265567.745276:0:15003:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789265567.745278:0:15003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265567.745281:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265567.745282:0:15003:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789265567.745285:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789265567.745384:0:15003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265567.745388:0:15003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265567.745390:0:15003:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789265567.745393:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789265567.745623:0:14989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789265567.745660:0:14989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789265567.745686:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef8190577 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819057e expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265567.745700:0:14989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403136c00/0x8e12577ef8190577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819057e expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265567.745905:0:14989:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925404c95800 from 1 10000000:01000000:3.0:1789265567.745909:0:14989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265567.745948:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265567.745956:0:14989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265567.745968:0:14989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265567.745993:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265567.746069:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265567.746113:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265567.746183:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553788160 00000100:00100000:1.0:1789265567.746191:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553788160 00000100:00100000:1.0:1789265567.746241:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265567.746268:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+14:14989:x1876180553788160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265567.746281:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265567.746293:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef8190593 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.746315:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef8190593 expref: 15 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.746325:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190593 expref: 15 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.746365:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92543bc5fa00, rc 0) 00000100:00100000:1.0:1789265567.746412:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788160:12345-0@lo:101:mount.lustre.0 Request processed in 154us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265567.746418:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265567.749775:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265567.749817:0:14989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.749832:0:14989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265567.750442:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789265567.750829:0:14989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265567.751118:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789265567.751166:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789265567.751230:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789265567.751241:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789265567.751324:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265567.751409:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265567.751456:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265567.751991:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553788288 00000100:00100000:3.0:1789265567.751999:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553788288 00000100:00100000:3.0:1789265567.752050:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265567.752059:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265567.752297:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788288:12345-0@lo:501:mount.lustre.0 Request processed in 238us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265567.752305:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265567.753904:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265567.753964:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265567.754039:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265567.754089:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265567.756168:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553788416 00000100:00100000:3.0:1789265567.756193:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553788416 00000100:00100000:3.0:1789265567.756275:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265567.756285:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265567.756534:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788416:12345-0@lo:503:mount.lustre.0 Request processed in 250us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265567.756541:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265567.756896:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788416:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789265567.758129:0:14989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265567.758222:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265567.758296:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265567.759553:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543d4b5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265567.763698:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553788544 00000100:00100000:3.0:1789265567.763723:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553788544 00000100:00100000:3.0:1789265567.763791:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265567.763804:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265567.764113:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788544:12345-0@lo:502:mount.lustre.0 Request processed in 311us (5816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265567.764121:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265567.764606:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265567.765203:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789265567.765275:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789265567.765326:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789265567.765403:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789265567.765434:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789265567.765494:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789265567.765528:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789265567.765565:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789265567.765609:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265567.765676:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265567.765958:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553788672 00000100:00100000:2.0:1789265567.765964:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553788672 00000100:00100000:2.0:1789265567.766015:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265567.766024:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265567.766201:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788672:12345-0@lo:502:mount.lustre.0 Request processed in 177us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265567.766209:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265567.766284:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265567.766303:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265567.766482:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789265567.766492:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789265567.769974:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265567.769987:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265567.769990:0:15007:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265567.769997:0:15007:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff925404c95800 00000020:00000080:3.0:1789265567.770000:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265567.770007:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265567.770010:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265567.770012:0:15007:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789265567.770015:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265567.770017:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265567.770018:0:15007:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265567.770022:0:15007:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff925404c95800 00000020:00000080:3.0:1789265567.770024:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265567.770142:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265567.770146:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265567.770148:0:15007:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789265567.770151:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265567.770169:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265567.770170:0:15007:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265567.770175:0:15007:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff925404c95800 00000020:00000080:3.0:1789265567.770177:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265567.774010:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265567.774023:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265567.774025:0:15007:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789265567.774029:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789265567.781076:0:14989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789265567.781119:0:14989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265567.782020:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.782035:0:14989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265567.782093:0:14989:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789265567.782096:0:14989:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff925404c95800 10000000:01000000:1.0:1789265567.782099:0:14989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff925404c95800 10000000:01000000:1.0:1789265567.782102:0:14989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265567.782108:0:14989:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff925404c95800 from 1 10000000:01000000:1.0:1789265567.782111:0:14989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265567.782151:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5fc00/0x8e12577ef81905a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.782159:0:14989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92543bc5fc00/0x8e12577ef81905a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.782170:0:14989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92543bc5fc00/0x8e12577ef81905a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265567.782193:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265567.782274:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265567.782316:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265567.784203:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553788800 00000100:00100000:2.0:1789265567.784217:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553788800 00000100:00100000:2.0:1789265567.784281:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265567.784292:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553788800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265567.784307:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265567.784326:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403137000/0x8e12577ef81905a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef81905a1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.784372:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403137000/0x8e12577ef81905a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef81905a1 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.784398:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403137000/0x8e12577ef81905a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81905a1 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265567.784407:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403137000, rc 0) 00000100:00100000:2.0:1789265567.784481:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553788800:12345-0@lo:101:mount.lustre.0 Request processed in 192us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265567.784488:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265567.786922:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265567.786961:0:14989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92543bc5fc00/0x8e12577ef81905a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81905a8 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.786974:0:14989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92543bc5fc00/0x8e12577ef81905a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef81905a8 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265567.787645:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789265567.790010:0:14989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265567.790305:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789265567.791298:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789265567.791448:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789265567.791511:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789265567.791549:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789265567.791595:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789265567.791629:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789265567.791681:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789265567.792487:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789265567.792541:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789265567.792576:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789265567.792621:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789265567.792652:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789265567.792678:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789265567.793578:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789265567.793635:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789265567.793941:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789265567.794013:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789265567.794050:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789265567.794079:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789265567.794120:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789265567.794153:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789265567.794184:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789265567.794248:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789265567.794307:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789265567.794379:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789265567.794434:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789265567.794472:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789265567.794565:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789265567.794573:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789265567.794684:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265567.796062:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265567.796108:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265567.796410:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553788928 00000100:00100000:3.0:1789265567.796418:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553788928 00000100:00100000:3.0:1789265567.796469:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265567.796478:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553788928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265567.807472:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553788928:12345-0@lo:501:mount.lustre.0 Request processed in 10984us (11402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265567.807488:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265567.807662:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553788928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265567.807724:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553789056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265567.807775:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265567.807817:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265567.807872:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553789056 00000100:00100000:3.0:1789265567.807879:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553789056 00000100:00100000:3.0:1789265567.807929:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265567.807940:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553789056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265567.808133:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553789056:12345-0@lo:503:mount.lustre.0 Request processed in 194us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265567.808141:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265567.808280:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553789056:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265567.808863:0:14989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265567.808939:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553789184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265567.808995:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265567.809029:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925401359cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265567.809770:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553789184 00000100:00100000:3.0:1789265567.809779:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553789184 00000100:00100000:3.0:1789265567.809825:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265567.809835:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553789184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265567.810049:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553789184:12345-0@lo:502:mount.lustre.0 Request processed in 216us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265567.810067:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265567.810492:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553789184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265567.810752:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789265567.810801:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789265567.810829:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789265567.810882:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789265567.810919:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789265567.810963:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789265567.810998:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789265567.811045:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789265567.811102:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789265567.811133:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789265567.811159:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789265567.811198:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789265567.811235:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789265567.811280:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789265567.811356:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789265567.811393:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789265567.811421:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789265567.811464:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789265567.811497:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789265567.811526:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789265567.811567:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789265567.811599:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789265567.811630:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789265567.811699:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789265567.811735:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789265567.811765:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789265567.811808:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789265567.811844:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789265567.811879:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789265567.811924:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789265567.811958:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789265567.811989:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789265567.812022:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789265567.812070:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789265567.812105:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789265567.812149:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789265567.812185:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789265567.812217:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789265567.812266:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789265567.812317:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789265567.812394:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553789312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265567.812484:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265567.812539:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403f8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265567.812652:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553789312 00000100:00100000:0.0:1789265567.812660:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553789312 00000100:00100000:0.0:1789265567.812708:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789265567.812718:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553789312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265567.812953:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553789312:12345-0@lo:502:mount.lustre.0 Request processed in 236us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.812960:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265567.816635:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553789312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265567.816804:0:14989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789265567.816822:0:14989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789265567.826638:0:15012:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789265567.826658:0:15012:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9254374c0000) 00000020:00000080:0.0:1789265567.826678:0:15012:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789265567.826759:0:15012:0:(tgt_mount.c:153:server_get_mount()) get mount ffff925404c95800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265567.826764:0:15012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff925404c95800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265567.826767:0:15012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff925404c95800 3 00010000:00080000:0.0:1789265567.826851:0:15012:0:(ldlm_lib.c:102:import_set_conn()) imp ffff925441bec800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.143@tcp at head 00010000:00010000:0.0:1789265567.832447:0:15012:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789265567.832660:0:15012:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789265567.832699:0:15012:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265567.832713:0:15012:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8e12577ef81905b6 00000100:00080000:0.0:1789265567.832725:0:15012:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265567.832732:0:15012:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff925441bec800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1789265567.832793:0:15012:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92544185d880 x1876180553789440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265567.835199:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876180553789440:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265567.835294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265567.835438:0:15012:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789265567.835466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265567.835471:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265567.835475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265567.835477:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265567.835524:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265567.835534:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553789568:0@lo:400:kworker.0 00000100:00100000:0.0:1789265567.835565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265567.835607:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553789440 00000100:00100000:0.0:1789265567.835614:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553789440 00000100:00100000:0.0:1789265567.835640:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553789568 00000100:00100000:0.0:1789265567.835643:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553789568 00000100:00100000:0.0:1789265567.835689:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265567.835696:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553789568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265567.835749:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553789568:12345-0@lo:400:kworker.0 Request processed in 52us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.835756:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265567.835774:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265567.835778:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1876180553789440:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789265567.835799:0:14307:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:0.0:1789265567.835833:0:14307:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8e12577ef81905bd 00000004:00100000:0.0:1789265567.835850:0:14307:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789265567.835884:0:14307:0:(import.c:65:import_set_state_nolock()) ffff925441bed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265567.843034:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876180553789440:12345-0@lo:38:llog_process_th.0 Request processed in 7226us (7712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.843054:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265567.843816:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92544185f800 x1876180553789568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265567.843834:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553789568:0@lo:400:kworker.0 00010000:00080000:3.0:1789265567.848151:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92544185d880 x1876180553789440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265567.848165:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265567.848175:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789265567.848184:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265567.848189:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265567.848193:0:3303:0:(import.c:65:import_set_state_nolock()) ffff925441bec800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265567.848201:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876180553789440:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789265567.848583:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789265567.848724:0:14989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789265567.848755:0:14989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265567.848779:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5fc00/0x8e12577ef81905a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81905a8 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.849188:0:14989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92543bc5fc00/0x8e12577ef81905a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81905a8 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265567.849252:0:14989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265567.849265:0:14989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265567.849267:0:14989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265567.849268:0:14989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265567.849269:0:14989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265567.849271:0:14989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265567.849273:0:14989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265567.849275:0:14989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265567.849276:0:14989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265567.849280:0:14989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789265567.849282:0:14989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265567.849284:0:14989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265567.849285:0:14989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265567.849286:0:14989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265567.849287:0:14989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265567.849288:0:14989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265567.849289:0:14989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265567.849290:0:14989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265567.849291:0:14989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265567.849316:0:14989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789265567.849546:0:14989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553789696:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265567.849620:0:14989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265567.849653:0:14989:0:(client.c:2715:ptlrpc_set_wait()) set ffff925401359cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265567.849708:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553789696 00000100:00100000:3.0:1789265567.849715:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553789696 00000100:00100000:3.0:1789265567.849763:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265567.849772:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14989:x1876180553789696:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265567.849813:0:14301:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789265567.849827:0:14301:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789265567.875596:0:14301:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265567.875618:0:14301:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789265567.875672:0:14322:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789265567.875678:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789265567.875701:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.875732:0:14322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef819052a expref: 16 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.875741:0:14322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.876007:0:14322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef819052a expref: 16 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.876024:0:14322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef819052a expref: 16 pid: 14300 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265567.876040:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14322:1876180553789824:0@lo:104: 00000100:00100000:1.0:1789265567.876112:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265567.876162:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254085d7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265567.876511:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553789824 00000100:00100000:0.0:1789265567.876518:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553789824 00000100:00100000:0.0:1789265567.876561:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265567.876570:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:14322:x1876180553789824:12345-0@lo:104: 00010000:00010000:0.0:1789265567.876582:0:14290:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876633:0:14290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265567.876638:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:14322:x1876180553789824:12345-0@lo:104: Request processed in 69us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.876644:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789265567.876662:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265567.876667:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876674:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:0.0:1789265567.876678:0:14294:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876704:0:14294:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265567.876711:0:14294:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265567.876717:0:14294:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265567.876744:0:14294:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876750:0:14294:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265567.876767:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876773:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925441994000/0x8e12577ef819052a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef8190531 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876802:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265567.876804:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265567.876806:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265567.876818:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553789952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265567.876848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265567.876890:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553789952 00000100:00100000:0.0:1789265567.876895:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553789952 00010000:00010000:0.0:1789265567.876910:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef819052a expref: 17 pid: 14300 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265567.876929:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265567.876935:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:3305:x1876180553789952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265567.876952:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265567.876957:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef819052a expref: 17 pid: 14300 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876968:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef819052a expref: 17 pid: 14300 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876984:0:14293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.876992:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265567.877006:0:14293:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001327956s 00010000:00010000:0.0:1789265567.877010:0:14293:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.877017:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.877023:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.877029:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.877034:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265567.877038:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.877045:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.877061:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265567.877070:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265567.877097:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:3305:x1876180553789952:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.877105:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265567.877142:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553789952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265567.877511:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403137800/0x8e12577ef8190531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef819052a expref: 16 pid: 14300 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265567.877522:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14322:1876180553789824:0@lo:104: 00010000:00010000:1.0:1789265567.877536:0:14322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.877544:0:14322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.877559:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265567.877566:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92543bc5e000/0x8e12577ef81905c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265567.882380:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14989:x1876180553789696:12345-0@lo:253:mount.lustre.0 Request processed in 32597us (32747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265567.882394:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265567.882513:0:14989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14989:1876180553789696:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265567.882532:0:14989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789265567.882535:0:14989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265567.882537:0:14989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265567.882538:0:14989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265567.882539:0:14989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265567.882541:0:14989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265567.882542:0:14989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265567.882544:0:14989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265567.882546:0:14989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265567.882547:0:14989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265567.882563:0:14989:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789265567.887946:0:14989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265567.888124:0:14989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265567.888301:0:14989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265567.888499:0:14989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265567.888630:0:14989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265567.888835:0:14989:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789265567.889967:0:14989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789265567.937501:0:14989:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789265567.937508:0:14989:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789265567.937549:0:14989:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789265567.937608:0:14989:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789265567.937622:0:14989:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789265567.937653:0:14989:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789265568.421161:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265569.439613:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265569.502868:0:14303:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265569.502876:0:14303:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92543bbd7000 from 7 10000000:01000000:0.0:1789265569.502882:0:14303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265569.502934:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265569.502947:0:14303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265569.502959:0:14303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265569.502986:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553790080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265569.503062:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265569.503453:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925401359cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265569.506294:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553790080 00000100:00100000:2.0:1789265569.506309:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553790080 00000100:00100000:2.0:1789265569.506390:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265569.506400:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+15:14303:x1876180553790080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265569.506667:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265569.506692:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef81905cb expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265569.506723:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef81905cb expref: 16 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265569.506736:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81905cb expref: 16 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265569.506745:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136600, rc 0) 00000100:00100000:2.0:1789265569.506905:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14303:x1876180553790080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 505us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265569.506913:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265569.507889:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553790080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265569.507916:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265569.507929:0:14303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265569.508019:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553790208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789265569.508070:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265569.508130:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265569.508810:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553790208 00000100:00100000:0.0:1789265569.508824:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553790208 00000100:00100000:0.0:1789265569.508879:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265569.508889:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14303:x1876180553790208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789265569.508910:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265569.508926:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265569.508929:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789265569.509026:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14303:x1876180553790208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265569.509035:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265569.509812:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553790208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789265569.509886:0:14303:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265569.509897:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265569.509907:0:14303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265570.462640:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265571.491480:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265572.531888:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265573.279413:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265573.279420:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265573.279423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265573.279426:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265573.279467:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265573.279489:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876180553790592:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.279563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265573.282935:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3306:1876180553790336:0@lo:400:kworker.0 00000100:00100000:2.0:1789265573.283036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265573.283096:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265573.283105:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553790464:0@lo:400:kworker.0 00000100:00100000:2.0:1789265573.283134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265573.283198:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553790336 00000100:00100000:2.0:1789265573.283206:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553790336 00000100:00100000:2.0:1789265573.283246:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265573.283255:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:3306:x1876180553790336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265573.283306:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:3306:x1876180553790336:12345-0@lo:400:kworker.0 Request processed in 52us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265573.283314:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265573.283385:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3306:1876180553790336:0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.284056:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553790592 00000100:00100000:1.0:1789265573.284063:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553790592 00000100:00100000:1.0:1789265573.284111:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553790464 00000100:00100000:1.0:1789265573.284114:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553790464 00000100:00100000:1.0:1789265573.284940:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265573.285257:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876180553790592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.285442:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876180553790592:12345-0@lo:400:kworker.0 Request processed in 190us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265573.285450:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265573.285470:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265573.285548:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553790464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.285590:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553790464:12345-0@lo:400:kworker.0 Request processed in 44us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265573.285596:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789265573.285646:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92544185ce00 x1876180553790464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265573.285660:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553790464:0@lo:400:kworker.0 00010000:00080000:0.0:1789265573.285746:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92544185e300 x1876180553790592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265573.285757:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876180553790592:0@lo:400:kworker.0 00000100:00080000:2.0:1789265573.287122:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789265573.534891:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265574.559950:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265574.787786:0:15357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265575.582698:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265576.606752:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265576.927955:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265577.632370:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265578.400003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265578.400010:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265578.400013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265578.400016:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265578.400073:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265578.400093:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553790720:0@lo:400:kworker.0 00000100:00100000:1.0:1789265578.400188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265578.400239:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553790848:0@lo:400:kworker.0 00000100:00100000:1.0:1789265578.400266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265578.400286:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265578.400292:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553790976:0@lo:400:kworker.0 00000100:00100000:1.0:1789265578.400319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265578.400372:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553790720 00000100:00100000:1.0:1789265578.400380:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553790720 00000100:00100000:1.0:1789265578.400421:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265578.400428:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:3304:x1876180553790720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265578.400494:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:3304:x1876180553790720:12345-0@lo:400:kworker.0 Request processed in 66us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265578.400501:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265578.400530:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553790848 00000100:00100000:1.0:1789265578.400533:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553790848 00000100:00100000:1.0:1789265578.400555:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553790976 00000100:00100000:1.0:1789265578.400557:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553790976 00000100:00100000:1.0:1789265578.400578:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265578.400584:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553790848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265578.400617:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553790848:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265578.400622:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265578.400634:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265578.400639:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553790976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265578.400660:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553790976:12345-0@lo:400:kworker.0 Request processed in 22us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265578.400675:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265578.400728:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553790720:0@lo:400:kworker.0 00000100:00080000:1.0:1789265578.400751:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265578.400766:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543be41180 x1876180553790976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265578.400776:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553790976:0@lo:400:kworker.0 00010000:00080000:1.0:1789265578.400784:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543be40380 x1876180553790848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265578.400791:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553790848:0@lo:400:kworker.0 00010000:00010000:3.0:1789265578.654582:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265579.103128:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265564/real 1789265564] req@ffff925441a9e680 x1876180553786496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265579 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265579.103163:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff925441a9e680 x1876180553786496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265579 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265579.103175:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265564/real 1789265564] req@ffff925441a9f800 x1876180553786624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265579 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265579.103188:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff925441a9f800 x1876180553786624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265579 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265579.103211:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9254051e6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265579.103239:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265579.103263:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553786496:0@lo:8:kworker.0 00000100:00080000:2.0:1789265579.103269:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265579.103275:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265579.103277:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553786624:0@lo:8:kworker.0 00000100:00080000:3.0:1789265579.103496:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265579.103501:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789265579.103504:0:8:0:(import.c:65:import_set_state_nolock()) ffff9254051e6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265579.103510:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:3.0:1789265579.103515:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789265579.103522:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9254051e6800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1789265579.103542:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9f100 x1876180553791232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265579.103554:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265579.103563:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265579.103565:0:8:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265579.103568:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:3.0:1789265579.103570:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789265579.103574:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92543b68c800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1789265579.103585:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9d500 x1876180553791360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265579.103693:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553791104:0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.103760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265579.103813:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265579.103818:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553791488:0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.103841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265579.103872:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553791616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.103894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265579.103929:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553791488 00000100:00100000:1.0:1789265579.103936:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553791488 00000100:00100000:1.0:1789265579.103988:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553791616 00000100:00100000:1.0:1789265579.103991:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553791616 00000100:00100000:1.0:1789265579.104014:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265579.104023:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553791488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.104079:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876180553791488:12345-0@lo:400:kworker.0 Request processed in 57us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265579.104097:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265579.104115:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265579.104121:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553791616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.104154:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553791616:12345-0@lo:400:kworker.0 Request processed in 33us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265579.104160:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789265579.104199:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9f800 x1876180553791616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265579.104211:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553791616:0@lo:400:kworker.0 00010000:00080000:1.0:1789265579.104238:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9d180 x1876180553791488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265579.104247:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876180553791488:0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.104448:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553791104 00000100:00100000:3.0:1789265579.104453:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553791104 00000100:00100000:3.0:1789265579.104493:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265579.104501:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:3304:x1876180553791104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.104538:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:3304:x1876180553791104:12345-0@lo:400:kworker.0 Request processed in 38us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265579.104544:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265579.104623:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553791104:0@lo:400:kworker.0 00000100:00100000:2.0:1789265579.104721:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553791232:0@lo:8:kworker.0 00000100:00100000:2.0:1789265579.104763:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265579.104799:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553791360:0@lo:8:kworker.0 00000100:00100000:2.0:1789265579.104820:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265579.104895:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553791232 00000100:00100000:1.0:1789265579.104899:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553791232 00000100:00100000:1.0:1789265579.104924:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553791360 00000100:00100000:1.0:1789265579.104927:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553791360 00000100:00100000:1.0:1789265579.104939:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265579.104944:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876180553791232:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789265579.104979:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:1.0:1789265579.105132:0:14992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef81905d9 00002000:00100000:1.0:1789265579.105148:0:14992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92540c27d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789265579.105153:0:14992:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789265579.105166:0:14992:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789265579.105579:0:14992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789265579.105610:0:14992:0:(import.c:65:import_set_state_nolock()) ffff92540c27f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265579.105661:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876180553791232:12345-0@lo:8:kworker.0 Request processed in 715us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265579.105669:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265579.105687:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265579.105692:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876180553791360:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789265579.105704:0:14992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265579.105727:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876180553791360:12345-0@lo:8:kworker.0 Request processed in 34us (905us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265579.105733:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265579.106321:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9f100 x1876180553791232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265579.106349:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265579.106356:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789265579.106363:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789265579.106368:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789265579.106371:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9254051e6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789265579.106393:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789265579.106398:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553791232:0@lo:8:kworker.0 00000100:00080000:2.0:1789265579.106410:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265579.106414:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789265579.106417:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553791360:0@lo:8:kworker.0 00000004:00080000:3.0:1789265579.106488:0:14328:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265579.106777:0:14328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434340443927ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789265579.108394:0:14329:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1789265579.108424:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14329:1876180553791872:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789265579.108495:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265579.108526:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff925409d9d600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265579.108549:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553791744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265579.108578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265579.108623:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553791744 00000100:00100000:1.0:1789265579.108631:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553791744 00000100:00100000:1.0:1789265579.108690:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265579.108700:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553791744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265579.108742:0:14994:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265579.108789:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553791744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265579.110849:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789265579.110913:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265579.110972:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92543be43b80 x1876180553791744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265595 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265579.111001:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553791744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265579.111071:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553791872 00000100:00100000:1.0:1789265579.111078:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553791872 00000100:00100000:1.0:1789265579.111126:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265579.111135:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14329:x1876180553791872:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789265579.123809:0:14992:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789265579.123821:0:14992:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789265579.123826:0:14992:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1789265579.139185:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.139197:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.139215:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.139219:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.139225:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.139242:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.139252:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.139260:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.139302:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265579.140273:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265579.140281:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.140292:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ea00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265579.140296:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.140306:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.140363:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.140371:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef81905e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.140393:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265579.140395:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265579.140397:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.147936:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.147950:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.147968:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.147973:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.147980:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.147996:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.148007:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.148015:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.148052:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265579.148915:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.148925:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.148936:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fe00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.148948:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.148959:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.148984:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.148991:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef81905e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.149013:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.149015:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.149017:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.153247:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.153262:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.153279:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.153289:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.153297:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.153311:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.153322:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.153344:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.153380:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265579.153974:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.153982:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.153991:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.153995:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.154004:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.154022:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.154049:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef81905ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.154070:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.154072:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.154074:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.154884:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.154893:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.154906:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.154910:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.154916:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.154927:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.154936:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.154951:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.155010:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265579.156294:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.156305:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.156318:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.156322:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.156327:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.156366:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.156376:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.156383:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160700:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265579.160717:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160732:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.160737:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160748:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160772:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160780:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef81905f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160800:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.160804:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160835:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.160838:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160845:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160855:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.160862:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.160864:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.160866:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.169013:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789265579.169032:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef81905fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.169671:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789265579.171074:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789265579.171264:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.171273:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.171290:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.171294:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.171300:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.171314:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.171324:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.171355:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.171372:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265579.172056:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.172064:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172075:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.172086:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.172092:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172102:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172111:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172118:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172140:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265579.172153:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265579.172158:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172166:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265579.172170:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172179:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172195:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172214:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190603 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172235:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265579.172238:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172246:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ec00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265579.172250:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172258:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172270:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172278:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819060a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.172290:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.172292:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.172294:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.174960:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.175407:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.175419:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.175446:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.175450:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.175456:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.175470:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.175481:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.175930:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.175964:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265579.176640:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.176649:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.176658:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.176663:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.176673:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.176704:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.176711:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af2f1877/0x8e12577ef8190611 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.176731:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.176732:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.176734:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.178155:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.178166:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178180:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.178184:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.178189:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178201:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178223:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178230:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178311:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265579.178802:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.178808:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178831:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.178834:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.178839:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178850:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178858:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.178866:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179806:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265579.179825:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179836:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.179840:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179850:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179866:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179873:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fde627/0x8e12577ef8190618 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179900:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.179903:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179909:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.179912:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179919:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179928:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.179935:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.179936:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.179938:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.180131:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789265579.180138:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bce18649/0x8e12577ef819061f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265579.180938:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.180947:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.180960:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.180963:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.180969:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.180980:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.180988:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.180996:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.181018:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265579.181030:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265579.181048:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.181064:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ea00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265579.181068:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.181075:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.181089:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.181096:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c22836/0x8e12577ef8190626 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.181112:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.181114:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.181115:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.181687:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.182505:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.182517:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.182542:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.182546:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.182553:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.182567:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.182590:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.182597:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.182619:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265579.183145:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.183152:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.183162:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.183165:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.183169:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.183179:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.183186:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.183192:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.183224:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789265579.184265:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265579.184275:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184286:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ec00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.184290:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184313:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184353:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184361:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008295a8d1/0x8e12577ef819062d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184378:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.184382:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184388:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.184391:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184399:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184410:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184418:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001302bf6b/0x8e12577ef8190634 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.184444:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.184446:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.184448:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.185949:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.185965:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.185980:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.185984:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.185990:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.186004:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.186013:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.186022:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.186059:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265579.186725:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.186733:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.186743:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5e800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.186748:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.186756:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.186773:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.186780:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028a09afa/0x8e12577ef819063b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.187092:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.187135:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.187137:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.187139:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.187417:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.187425:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.187436:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.187448:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.187453:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.187464:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.187473:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.187759:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.187785:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265579.187893:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265579.187900:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.187908:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5f800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265579.187912:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.187920:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.187934:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.187942:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f443a9da/0x8e12577ef8190642 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.187972:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265579.187973:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265579.187975:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.188744:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.188754:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.188765:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.188769:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.188774:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.188786:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.188795:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.188888:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.188956:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265579.189444:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.189451:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.189461:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.189465:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.189469:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.189479:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.189497:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.189504:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.189930:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265579.189937:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.189959:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5fe00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.189963:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.189972:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.189989:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.189996:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051845167/0x8e12577ef8190649 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.190016:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.190019:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.190027:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304271200 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.190030:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.190048:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.190058:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.190073:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.190075:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.190077:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.190139:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789265579.190145:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e93056/0x8e12577ef8190650 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.190416:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.190968:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.190975:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.190987:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.190990:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.190995:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.191006:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.191015:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.191022:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.191097:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265579.191668:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.191674:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.191684:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.191687:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.191698:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.191708:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.191717:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.191725:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192187:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265579.192197:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192208:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304270c00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.192214:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192223:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192243:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192250:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feac177f/0x8e12577ef8190657 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192270:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.192273:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192280:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304270800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.192291:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192299:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192310:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.192318:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.192320:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.192322:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.192691:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789265579.192699:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e6fb95/0x8e12577ef819065e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265579.192904:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.193457:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.193465:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.193477:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.193491:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.193498:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.193702:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.193727:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.193735:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.193753:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265579.193927:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.193934:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.193943:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304270400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.193947:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.193957:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.193972:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.193979:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f4bfa2d/0x8e12577ef8190665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.194003:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.194005:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.194007:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.194803:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.194931:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.194946:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.194950:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.194956:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.194968:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.194978:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.194987:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.195023:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265579.196663:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.196675:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.196688:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304271a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.196693:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.196704:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.196726:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.196732:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042fb13e2/0x8e12577ef819066c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.196751:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.196753:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.196755:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265579.197179:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.197188:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.197200:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.197205:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.197210:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.197223:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.197232:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.197240:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.197308:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265579.197959:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.197966:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.197977:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.197987:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.197992:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.198003:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.198011:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.198019:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198651:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265579.198660:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198682:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304271400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.198687:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198696:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198713:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198721:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc3c2846/0x8e12577ef8190673 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198742:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265579.198745:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198752:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304271800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265579.198755:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198763:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198771:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.198787:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.198788:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.198791:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.206397:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789265579.206411:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef819067a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265579.207225:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.207234:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.207249:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.207254:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.207261:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.207276:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.207293:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.207302:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.210826:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265579.210841:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.210855:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304270a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265579.210870:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.210881:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.210905:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.212690:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789265579.212704:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec3ca18a/0x8e12577ef8190681 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.218658:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.218667:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265579.218670:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265579.219694:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265579.226494:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789265579.226511:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.226688:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1789265579.226695:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265579.226701:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.226719:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.226731:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.226739:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.227647:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789265579.228481:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789265579.228497:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.228511:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1789265579.228516:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265579.228521:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.230054:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.230068:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265579.230076:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230362:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265579.230372:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230381:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265579.230386:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230395:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230413:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230420:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000712ea949/0x8e12577ef8190688 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230460:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265579.230464:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230470:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265579.230473:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230491:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230506:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.230515:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265579.230517:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265579.230519:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265579.230737:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265579.230762:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789265579.230769:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f9f4668/0x8e12577ef819068f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265579.232009:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265579.232021:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.232048:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789265579.232053:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265579.232058:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.232070:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.232093:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.232101:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265579.232161:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789265579.232408:0:14992:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1789265579.232521:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14329:x1876180553791872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 121383us (124021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265579.232531:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265579.232707:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14329:1876180553791872:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789265579.232722:0:14329:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1789265579.232770:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14329:1876180553792000:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789265579.232822:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265579.232871:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405fc29c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789265579.233109:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265579.233117:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.233127:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304271800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265579.233131:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.233153:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.233172:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265579.233180:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd2ff7ae/0x8e12577ef8190696 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265579.233215:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553792000 00000100:00100000:2.0:1789265579.233222:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553792000 00000100:00100000:2.0:1789265579.233306:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265579.233315:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14329:x1876180553792000:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789265579.233377:0:14993:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789265579.241854:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14329:x1876180553792000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8532us (9036us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789265579.241867:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789265579.242017:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265579.242020:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265579.242022:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265579.242447:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14329:1876180553792000:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789265579.242467:0:14329:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789265579.683444:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265580.702628:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265581.738404:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265582.754608:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265583.684577:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789265583.684607:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1789265583.782918:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265583.995262:0:15708:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265583.995265:0:15708:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789265583.995430:0:15708:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92542d5f8000 00000020:01000004:3.0:1789265583.995447:0:15708:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789265583.995460:0:15708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789265583.995473:0:15708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff925402d50000) 00000020:00000080:3.0:1789265583.995486:0:15708:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789265584.071095:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789265584.071376:0:15708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789265584.073482:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789265584.075985:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789265584.076701:0:15708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789265584.077193:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 514: rc = 0 00100000:10000000:2.0:1789265584.077387:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 514: rc = 0 00100000:10000000:2.0:1789265584.078021:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 514: rc = 0 00100000:10000000:2.0:1789265584.084648:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1789265584.086838:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 775: rc = 0 00100000:10000000:2.0:1789265584.087156:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 775: rc = 0 00100000:10000000:2.0:1789265584.087671:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:2.0:1789265584.088022:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 775: rc = 0 00100000:10000000:2.0:1789265584.088594:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 775: rc = 0 00000020:00000080:2.0:1789265584.089743:0:15708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789265584.089755:0:15708:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265584.089768:0:15708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8e12577ef81906a4 00000020:01000004:2.0:1789265584.089777:0:15708:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789265584.089799:0:15708:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789265584.089803:0:15708:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789265584.089809:0:15708:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789265584.090482:0:15708:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789265584.090543:0:15708:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789265584.145872:0:15708:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789265584.145914:0:15708:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.143@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789265584.145919:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789265584.145921:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265584.145923:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265584.145924:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265584.145925:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265584.145927:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265584.145929:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265584.145931:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265584.145936:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789265584.145960:0:15708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789265584.145963:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265584.145964:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265584.145965:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265584.145966:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265584.145967:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265584.145968:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265584.145969:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265584.145969:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265584.145970:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789265584.145998:0:15708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789265584.146018:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789265584.146087:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.146157:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543d395f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265584.147542:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553792128 00000100:00100000:1.0:1789265584.147554:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553792128 00000100:00100000:1.0:1789265584.147634:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265584.147648:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:15708:x1876180553792128:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789265584.147715:0:14298:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789265584.147719:0:14298:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789265584.147722:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789265584.164761:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:15708:x1876180553792128:12345-0@lo:253:mount.lustre.0 Request processed in 17103us (18658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265584.164777:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265584.165052:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789265584.165070:0:15708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789265584.165074:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265584.165075:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265584.165077:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265584.165078:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265584.165079:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265584.165080:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265584.165082:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265584.165083:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265584.165084:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789265584.165108:0:15708:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92542d5f8000 from lustre-OST0001 10000000:01000000:2.0:1789265584.165156:0:15708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789265584.165160:0:15708:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789265584.165168:0:15708:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92543d3b8000 local copy 00010000:00010000:2.0:1789265584.165180:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265584.165496:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265584.165546:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.165601:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543d395cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265584.166233:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553792256 00000100:00100000:1.0:1789265584.166242:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553792256 00000100:00100000:1.0:1789265584.166303:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265584.166315:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:15708:x1876180553792256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265584.166926:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:15708:x1876180553792256:12345-0@lo:501:mount.lustre.0 Request processed in 612us (1379us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265584.167205:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265584.168115:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792256:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789265584.168224:0:15708:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789265584.169097:0:15708:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789265584.169111:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.169137:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92543bc5f400/0x8e12577ef8190451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190458 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265584.169174:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92542d5f8000 10000000:01000000:2.0:1789265584.169179:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789265584.169186:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789265584.169188:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265584.169193:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789265584.169196:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789265584.169237:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef81906ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.169246:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef81906ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.169256:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef81906ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265584.169280:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265584.169715:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.169783:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543d395cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265584.170107:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553792384 00000100:00100000:0.0:1789265584.170115:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553792384 00000100:00100000:0.0:1789265584.170182:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265584.170190:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:15708:x1876180553792384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265584.170205:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265584.170221:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441995200/0x8e12577ef81906b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef81906ab expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.170244:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441995200/0x8e12577ef81906b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef81906ab expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.170256:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441995200/0x8e12577ef81906b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81906ab expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.170265:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995200, rc 0) 00000100:00100000:0.0:1789265584.170320:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553792384:12345-0@lo:101:mount.lustre.0 Request processed in 131us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265584.170326:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265584.172315:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265584.172397:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef81906ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906b2 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.172411:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef81906ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef81906b2 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265584.173158:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789265584.174005:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265584.174242:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789265584.174285:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789265584.174311:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789265584.174402:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789265584.174438:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789265584.174466:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789265584.174519:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789265584.174527:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789265584.174606:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437480a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265584.174673:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.174727:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff92543d395600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265584.175511:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553792512 00000100:00100000:1.0:1789265584.175520:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553792512 00000100:00100000:1.0:1789265584.175597:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265584.175607:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553792512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265584.176112:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553792512:12345-0@lo:501:mount.lustre.0 Request processed in 506us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.176365:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437480a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265584.176428:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265584.176480:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.176516:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405fc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265584.176538:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553792640 00000100:00100000:2.0:1789265584.176545:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553792640 00000100:00100000:2.0:1789265584.176582:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265584.176589:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553792640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265584.176851:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265584.177040:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553792640:12345-0@lo:503:mount.lustre.0 Request processed in 450us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.177049:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265584.177073:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265584.178008:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265584.178087:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265584.178228:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.178275:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405fc2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265584.178372:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553792768 00000100:00100000:1.0:1789265584.178378:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553792768 00000100:00100000:1.0:1789265584.178573:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265584.178584:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553792768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265584.178807:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553792768:12345-0@lo:502:mount.lustre.0 Request processed in 225us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265584.178815:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265584.178906:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265584.179162:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789265584.179213:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789265584.179246:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789265584.179291:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789265584.179372:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789265584.179428:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789265584.179477:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789265584.179527:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789265584.179571:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789265584.179603:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265584.179651:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.180232:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925405fc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265584.180321:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553792896 00000100:00100000:0.0:1789265584.180329:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553792896 00000100:00100000:0.0:1789265584.180396:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265584.180405:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553792896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265584.180598:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553792896:12345-0@lo:502:mount.lustre.0 Request processed in 194us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265584.180614:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789265584.180783:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553792896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265584.180865:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789265584.180877:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789265584.181948:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265584.181959:0:15709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789265584.181966:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265584.181968:0:15709:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789265584.181975:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265584.181990:0:15709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff925402d519b8) 00000020:00000080:3.0:1789265584.182011:0:15709:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789265584.182016:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789265584.182077:0:15709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92542d5f8000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789265584.182083:0:15709:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789265584.182090:0:15709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8e12577ef81906c0 00010000:00010000:3.0:1789265584.187435:0:15709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789265584.187928:0:15709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789265584.189889:0:15709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789265584.191537:0:15709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789265584.191551:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265584.191557:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265584.191559:0:15709:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789265584.191564:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265584.191568:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265584.191570:0:15709:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789265584.191574:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789265584.191576:0:15709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789265584.191579:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265584.191581:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265584.191583:0:15709:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789265584.191585:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265584.191587:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265584.191589:0:15709:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265584.191593:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789265584.191650:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265584.191653:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265584.191654:0:15709:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265584.191657:0:15709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789265584.191973:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789265584.192004:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789265584.192026:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef81906ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906b2 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.192060:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925403137200/0x8e12577ef81906ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906b2 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265584.192070:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92542d5f8000 from 1 10000000:01000000:3.0:1789265584.192074:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265584.192115:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.192123:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.192134:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265584.192160:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265584.192242:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.192284:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b8b1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265584.192407:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553793024 00000100:00100000:2.0:1789265584.192424:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553793024 00000100:00100000:2.0:1789265584.192470:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265584.192478:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:15708:x1876180553793024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265584.192491:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265584.192503:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef81906c7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.192525:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.192535:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.192543:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136400, rc 0) 00000100:00100000:2.0:1789265584.192587:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793024:12345-0@lo:101:mount.lustre.0 Request processed in 109us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.192593:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265584.192734:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265584.192748:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.192757:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265584.194049:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789265584.195011:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265584.195264:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789265584.195307:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789265584.195418:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789265584.195426:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789265584.197250:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265584.197318:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.197467:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b8b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265584.197566:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553793152 00000100:00100000:1.0:1789265584.197574:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553793152 00000100:00100000:1.0:1789265584.197628:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265584.197640:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265584.197876:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793152:12345-0@lo:501:mount.lustre.0 Request processed in 239us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265584.197884:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265584.197921:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265584.198019:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265584.198059:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.198084:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b8b1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265584.198128:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553793280 00000100:00100000:2.0:1789265584.198133:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553793280 00000100:00100000:2.0:1789265584.198169:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789265584.198177:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265584.198593:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793280:12345-0@lo:503:mount.lustre.0 Request processed in 416us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.198601:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265584.198675:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265584.199490:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265584.199578:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265584.199626:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.199660:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925407387840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265584.199720:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553793408 00000100:00100000:1.0:1789265584.199726:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553793408 00000100:00100000:1.0:1789265584.199756:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265584.199762:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a82e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265584.199953:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a82e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793408:12345-0@lo:502:mount.lustre.0 Request processed in 177us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265584.199961:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265584.200007:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265584.200208:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789265584.200247:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789265584.200596:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789265584.200637:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789265584.200662:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789265584.200709:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789265584.200737:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789265584.200782:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789265584.200813:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265584.200859:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265584.200896:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403e62600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265584.201022:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553793536 00000100:00100000:3.0:1789265584.201028:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553793536 00000100:00100000:3.0:1789265584.201131:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265584.201142:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540a82e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265584.201366:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540a82e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793536:12345-0@lo:502:mount.lustre.0 Request processed in 226us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.201374:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265584.201579:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265584.201694:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789265584.201707:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789265584.202995:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265584.203009:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265584.203011:0:15713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265584.203020:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92542d5f8000 00000020:00000080:2.0:1789265584.203022:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265584.203039:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265584.203042:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265584.203044:0:15713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789265584.203047:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265584.203049:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265584.203051:0:15713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789265584.203053:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92542d5f8000 00000020:00000080:2.0:1789265584.203056:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265584.203162:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265584.203167:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265584.203168:0:15713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789265584.203171:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265584.203174:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265584.203175:0:15713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265584.203179:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92542d5f8000 00000020:00000080:2.0:1789265584.203181:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265584.205053:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265584.205062:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265584.205065:0:15713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789265584.205071:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789265584.208424:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789265584.208470:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265584.208496:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.208522:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265584.208574:0:15708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265584.208577:0:15708:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92542d5f8000 10000000:01000000:3.0:1789265584.208580:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92542d5f8000 10000000:01000000:3.0:1789265584.208585:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265584.208591:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92542d5f8000 from 1 10000000:01000000:3.0:1789265584.208593:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265584.208630:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441885200/0x8e12577ef81906d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.208638:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441885200/0x8e12577ef81906d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.208649:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441885200/0x8e12577ef81906d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265584.208673:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265584.208747:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.208796:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925407387300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265584.209272:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553793664 00000100:00100000:2.0:1789265584.209281:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553793664 00000100:00100000:2.0:1789265584.209559:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265584.209570:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553793664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265584.209585:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265584.209601:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136a00/0x8e12577ef81906dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef81906d5 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.209748:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136a00/0x8e12577ef81906dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef81906d5 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.209760:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136a00/0x8e12577ef81906dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81906d5 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.209778:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136a00, rc 0) 00000100:00100000:2.0:1789265584.209836:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553793664:12345-0@lo:101:mount.lustre.0 Request processed in 268us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.209843:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265584.210127:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265584.210145:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441885200/0x8e12577ef81906d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906dc expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.210156:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441885200/0x8e12577ef81906d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef81906dc expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265584.210789:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789265584.212428:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265584.212727:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789265584.212772:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789265584.213989:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789265584.214077:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789265584.214115:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789265584.214167:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789265584.214205:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789265584.214238:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789265584.214282:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789265584.214322:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789265584.214378:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789265584.214429:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789265584.214466:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789265584.214525:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789265584.214576:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789265584.214612:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789265584.214646:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789265584.214690:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789265584.214726:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789265584.214759:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789265584.215100:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789265584.215144:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789265584.215178:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789265584.215228:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789265584.215263:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789265584.215299:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789265584.215369:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789265584.215896:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789265584.215956:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789265584.216037:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789265584.216075:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789265584.216109:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789265584.216144:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789265584.216200:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789265584.216237:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789265584.216300:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789265584.216364:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789265584.216488:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789265584.216497:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789265584.216605:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265584.216674:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.216736:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925407387300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265584.216790:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553793792 00000100:00100000:2.0:1789265584.216800:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553793792 00000100:00100000:2.0:1789265584.216854:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265584.216865:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553793792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265584.217138:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553793792:12345-0@lo:501:mount.lustre.0 Request processed in 273us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.217147:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265584.217973:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265584.218020:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265584.218068:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.218112:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925407387300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265584.218188:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553793920 00000100:00100000:2.0:1789265584.218194:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553793920 00000100:00100000:2.0:1789265584.218231:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265584.218239:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553793920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265584.218754:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553793920:12345-0@lo:503:mount.lustre.0 Request processed in 514us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.218762:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265584.218953:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553793920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265584.219761:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265584.220657:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553794048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265584.220731:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.220771:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553794048 00000100:00100000:3.0:1789265584.220777:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553794048 00000100:00100000:3.0:1789265584.220893:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265584.220903:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553794048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265584.221421:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553794048:12345-0@lo:502:mount.lustre.0 Request processed in 518us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.221439:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265584.221498:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925407387300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265584.221519:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553794048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265584.224954:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789265584.225079:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789265584.225140:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789265584.225217:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789265584.225280:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789265584.225325:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789265584.225379:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789265584.225411:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789265584.225457:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789265584.225493:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789265584.225526:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789265584.225588:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789265584.225633:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789265584.225688:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789265584.225752:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789265584.225795:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789265584.225839:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789265584.225889:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789265584.225926:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789265584.225981:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789265584.226062:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789265584.226107:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789265584.226150:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789265584.226215:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789265584.226257:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789265584.226291:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789265584.226360:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789265584.226410:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789265584.226443:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789265584.226495:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789265584.226535:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789265584.226569:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789265584.226604:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789265584.226653:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789265584.226690:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789265584.226738:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789265584.226794:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789265584.226830:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789265584.226879:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789265584.226915:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789265584.226977:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553794176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265584.227062:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.227126:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553794176 00000100:00100000:3.0:1789265584.227133:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553794176 00000100:00100000:3.0:1789265584.227177:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265584.227184:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553794176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265584.227423:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553794176:12345-0@lo:502:mount.lustre.0 Request processed in 238us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.227432:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265584.227497:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff925407387300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265584.227525:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553794176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265584.227598:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789265584.227607:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789265584.231307:0:15718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789265584.231424:0:15718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff925305888000) 00000020:00000080:3.0:1789265584.231450:0:15718:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789265584.231555:0:15718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92542d5f8000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789265584.231560:0:15718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92542d5f8000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789265584.231563:0:15718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92542d5f8000 3 00010000:00080000:3.0:1789265584.231594:0:15718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff925305895000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.143@tcp at head 00010000:00010000:3.0:1789265584.233443:0:15718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789265584.233650:0:15718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789265584.233687:0:15718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265584.233699:0:15718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8e12577ef81906ea 00000100:00080000:3.0:1789265584.233709:0:15718:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265584.233715:0:15718:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff925305895000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1789265584.233751:0:15718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9c380 x1876180553794304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265584.233816:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876180553794304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789265584.233889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789265584.233957:0:15718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789265584.234018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265584.234023:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265584.234025:0:8:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265584.234030:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1789265584.234034:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1789265584.234038:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1789265584.234039:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92543b68c800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:2.0:1789265584.234055:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553794432:0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.234059:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925441a9df80 x1876180553794560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265584.234094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265584.234129:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553794560:0@lo:8:kworker.0 00000100:00100000:0.0:1789265584.234152:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553794432 00000100:00100000:0.0:1789265584.234159:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553794432 00000100:00100000:1.0:1789265584.234167:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265584.234216:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553794560 00000100:00100000:1.0:1789265584.234217:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553794304 00000100:00100000:0.0:1789265584.234220:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553794560 00000100:00100000:1.0:1789265584.234223:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553794304 00000100:00100000:0.0:1789265584.234237:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265584.234248:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553794432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265584.234253:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265584.234259:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876180553794304:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789265584.234296:0:14308:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1789265584.234357:0:14308:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8e12577ef81906f1 00000004:00100000:1.0:1789265584.234374:0:14308:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265584.234407:0:14308:0:(import.c:65:import_set_state_nolock()) ffff92542d52a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265584.234455:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876180553794304:12345-0@lo:38:llog_process_th.0 Request processed in 194us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265584.234464:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265584.234469:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265584.234478:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1789265584.234494:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265584.234512:0:14991:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789265584.234525:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265584.234530:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876180553794560:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789265584.234572:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876180553794560:12345-0@lo:8:kworker.0 Request processed in 39us (404us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789265584.234578:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265584.234736:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265584.234744:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265584.234749:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789265584.234753:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553794560:0@lo:8:kworker.0 00000100:00100000:0.0:1789265584.234761:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553794432:12345-0@lo:400:kworker.0 Request processed in 513us (664us total) trans 0 rc 0/0 00010000:00080000:1.0:1789265584.234769:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9c380 x1876180553794304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265584.234770:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265584.234781:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265584.234786:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789265584.234793:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789265584.234797:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265584.234799:0:3303:0:(import.c:65:import_set_state_nolock()) ffff925305895000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265584.234804:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876180553794304:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265584.234863:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789265584.234880:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553794432:0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.236286:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553794688:0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.236365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789265584.236750:0:15718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1789265584.237058:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553794816:0@lo:400:kworker.0 00000100:00100000:1.0:1789265584.237100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265584.237152:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553794688 00000100:00100000:1.0:1789265584.237158:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553794688 00000100:00100000:1.0:1789265584.237196:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553794816 00000100:00100000:1.0:1789265584.237199:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553794816 00000100:00100000:1.0:1789265584.237226:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265584.237235:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553794688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265584.237288:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876180553794688:12345-0@lo:400:kworker.0 Request processed in 54us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265584.237296:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265584.237310:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265584.237316:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553794816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265584.237369:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553794816:12345-0@lo:400:kworker.0 Request processed in 54us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265584.237376:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789265584.237427:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9c000 x1876180553794688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265584.237441:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876180553794688:0@lo:400:kworker.0 00000100:00080000:1.0:1789265584.237471:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265584.237490:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925441a9d880 x1876180553794816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265584.237500:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553794816:0@lo:400:kworker.0 00000020:01000000:1.0:1789265584.237526:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789265584.238252:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265584.238283:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441885200/0x8e12577ef81906d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906dc expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265584.238295:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441885200/0x8e12577ef81906d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef81906dc expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265584.238765:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265584.238768:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265584.238769:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265584.238770:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265584.238772:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265584.238773:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265584.238775:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265584.238777:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265584.238778:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265584.238783:0:15708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789265584.238785:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265584.238786:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265584.238788:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265584.238789:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265584.238789:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265584.238791:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265584.238792:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265584.238793:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265584.238794:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265584.238817:0:15708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789265584.238837:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553794944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265584.238895:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265584.239094:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540c292a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265584.239160:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553794944 00000100:00100000:3.0:1789265584.239167:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553794944 00000100:00100000:3.0:1789265584.239222:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265584.239232:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925403ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:15708:x1876180553794944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265584.239268:0:14300:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789265584.239282:0:14300:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789265584.253694:0:14300:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789265584.253714:0:14300:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789265584.253783:0:14322:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265584.253798:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265584.253824:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.253844:0:14322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81905cb expref: 19 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.253852:0:14322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.253892:0:14322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef81905cb expref: 19 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.253907:0:14322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef81905cb expref: 19 pid: 14300 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265584.253921:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14322:1876180553795072:0@lo:104: 00000100:00100000:0.0:1789265584.254004:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265584.254055:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265584.254083:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553795072 00000100:00100000:3.0:1789265584.254090:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553795072 00000100:00100000:3.0:1789265584.254130:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265584.254139:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:14322:x1876180553795072:12345-0@lo:104: 00010000:00010000:3.0:1789265584.254151:0:14289:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.254201:0:14289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265584.254206:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:14322:x1876180553795072:12345-0@lo:104: Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.254213:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265584.254214:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14322:1876180553795072:0@lo:104: 00010000:00010000:0.0:1789265584.254230:0:14322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.254451:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265584.254457:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.254465:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:0.0:1789265584.254468:0:14294:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.254489:0:14294:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265584.254497:0:14294:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265584.254503:0:14294:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265584.254536:0:14294:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.254543:0:14294:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789265584.254615:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3307:1876180553795200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265584.254654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.254697:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553795200 00000100:00100000:3.0:1789265584.254705:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553795200 00010000:00010000:3.0:1789265584.254734:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef81905cb expref: 20 pid: 14300 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.254985:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.254994:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925441994600/0x8e12577ef81905cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81905d2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265584.255013:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265584.255015:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265584.255017:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265584.255110:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265584.255119:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+20:3307:x1876180553795200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265584.255131:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265584.255137:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef81905cb expref: 20 pid: 14300 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255148:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef81905cb expref: 20 pid: 14300 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255175:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136600/0x8e12577ef81905d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef81905cb expref: 20 pid: 14300 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255188:0:14293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255195:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265584.255209:0:14293:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001411970s 00010000:00010000:3.0:1789265584.255214:0:14293:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255222:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255229:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255236:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255241:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265584.255245:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255252:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.255377:0:14322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265584.255441:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255472:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255486:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441995600/0x8e12577ef81906f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265584.255498:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265584.255640:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3307:1876180553795200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265584.255641:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3307:x1876180553795200:12345-0@lo:103:ldlm_bl.0 Request processed in 523us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.255649:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265584.261633:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925403ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:15708:x1876180553794944:12345-0@lo:253:mount.lustre.0 Request processed in 22394us (22728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.261644:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c79c9cb-ef4c-488b-80e5-fba066317ec7:15708:1876180553794944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265584.261649:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 10000000:01000000:2.0:1789265584.261661:0:15708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789265584.261664:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265584.261665:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265584.261667:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265584.261668:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265584.261669:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265584.261670:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265584.261672:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265584.261673:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265584.261674:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789265584.261693:0:15708:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789265584.266970:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265584.267144:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265584.267311:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265584.267663:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265584.267799:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265584.268000:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789265584.268601:0:15708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789265584.324528:0:15708:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789265584.324539:0:15708:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789265584.324576:0:15708:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265584.324653:0:15708:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265584.324671:0:15708:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789265584.324692:0:15708:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1789265584.544829:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265584.544853:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553795328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265584.544921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.545050:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553795328 00000100:00100000:2.0:1789265584.545059:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553795328 00000100:00100000:2.0:1789265584.545111:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265584.545135:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553795328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265584.545170:0:14994:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265584.545223:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553795328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.545230:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265584.545313:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553795328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265584.799158:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265585.825491:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789265586.014388:0:14303:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265586.014395:0:14303:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92543bbd7000 from 8 10000000:01000000:1.0:1789265586.014400:0:14303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265586.014447:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925304270000/0x8e12577ef81906ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265586.014457:0:14303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925304270000/0x8e12577ef81906ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265586.014468:0:14303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925304270000/0x8e12577ef81906ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265586.014494:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553795456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265586.014565:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265586.014618:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553795456 00000100:00100000:1.0:1789265586.014618:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b3cd540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265586.014626:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553795456 00000100:00100000:2.0:1789265586.014680:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789265586.014689:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:14303:x1876180553795456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265586.014712:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265586.014725:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925403136000/0x8e12577ef8190706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef81906ff expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265586.014749:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925403136000/0x8e12577ef8190706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef81906ff expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265586.014760:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925403136000/0x8e12577ef8190706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81906ff expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265586.014769:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925403136000, rc 0) 00000100:00100000:2.0:1789265586.014820:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:14303:x1876180553795456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265586.014826:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265586.014946:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553795456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265586.014961:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925304270000/0x8e12577ef81906ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190706 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265586.014971:0:14303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925304270000/0x8e12577ef81906ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190706 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265586.015022:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553795584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789265586.015055:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265586.015078:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540b3cd540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265586.015388:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553795584 00000100:00100000:2.0:1789265586.015393:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553795584 00000100:00100000:2.0:1789265586.015417:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789265586.015423:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:14303:x1876180553795584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789265586.015438:0:14300:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265586.015462:0:14300:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265586.015465:0:14300:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789265586.015561:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:14303:x1876180553795584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265586.015568:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265586.015940:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553795584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789265586.018070:0:14303:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265586.018093:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925304270000/0x8e12577ef81906ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190706 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265586.018106:0:14303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925304270000/0x8e12577ef81906ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190706 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265586.144630:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265586.858454:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265587.870598:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265588.897168:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265589.663527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265589.663534:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789265589.663538:0:37:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265589.663551:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92543b68c800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1789265589.663575:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92543be40e00 x1876180553795968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265589.663632:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553796224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.663709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265589.663778:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265589.663785:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553795712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.663813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265589.663849:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553796352:0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.663872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265589.663897:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553795840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.663922:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265589.663942:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265589.663947:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553796096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.663967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265589.664016:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543be40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553795968:0@lo:8:kworker.0 00000100:00100000:1.0:1789265589.664039:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265589.664072:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553796224 00000100:00100000:1.0:1789265589.664079:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553796224 00000100:00100000:1.0:1789265589.664123:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553796352 00000100:00100000:1.0:1789265589.664127:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553796352 00000100:00100000:1.0:1789265589.664144:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553796096 00000100:00100000:1.0:1789265589.664147:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553796096 00000100:00100000:1.0:1789265589.664162:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265589.664171:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553796224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.664222:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553796224:12345-0@lo:400:kworker.0 Request processed in 52us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265589.664229:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265589.664246:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265589.664253:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553796352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.664280:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553796352:12345-0@lo:400:kworker.0 Request processed in 28us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265589.664285:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265589.664297:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265589.664303:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553796096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.664353:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553796096:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265589.664361:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265589.664380:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553795712 00000100:00100000:1.0:1789265589.664383:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553795712 00000100:00100000:1.0:1789265589.664405:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265589.664411:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553795712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.664451:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553795712:12345-0@lo:400:kworker.0 Request processed in 40us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265589.664457:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265589.664489:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553795840 00000100:00100000:1.0:1789265589.664492:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553795840 00000100:00100000:1.0:1789265589.664519:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553795968 00000100:00100000:1.0:1789265589.664523:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553795968 00000100:00100000:1.0:1789265589.664546:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265589.664553:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553795840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.664584:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553795840:12345-0@lo:400:kworker.0 Request processed in 32us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265589.664589:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265589.664601:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265589.664605:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876180553795968:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789265589.664629:0:14991:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1789265589.664659:0:14991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e12577ef819070d 00002000:00100000:1.0:1789265589.664673:0:14991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9254377e9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789265589.664678:0:14991:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789265589.664681:0:14991:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789265589.665052:0:14991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789265589.665075:0:14991:0:(import.c:65:import_set_state_nolock()) ffff9254377ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265589.665127:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876180553795968:12345-0@lo:8:kworker.0 Request processed in 520us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265589.665134:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789265589.665161:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265589.665166:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265589.665474:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543be40e00 x1876180553795968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265589.665493:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789265589.665500:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265589.665506:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789265589.665508:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92543b68c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265589.665525:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265589.665531:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876180553795968:0@lo:8:kworker.0 00000004:00080000:1.0:1789265589.665561:0:14330:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789265589.665942:0:14330:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444899608637ns, next at 0ns, rc = 0 00010000:00080000:1.0:1789265589.666163:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543be43480 x1876180553796096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265589.666174:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553796096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.666189:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553795840:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.670500:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553795712:0@lo:400:kworker.0 00010000:00080000:0.0:1789265589.670534:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543be42680 x1876180553796352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265589.670549:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553796352:0@lo:400:kworker.0 00010000:00080000:0.0:1789265589.670563:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92543be40700 x1876180553796224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265589.670591:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543be40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553796224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265589.679520:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553796480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265589.679599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265589.680125:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553796608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265589.680161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789265589.680207:0:14331:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789265589.680241:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14331:1876180553796736:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789265589.680267:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265589.680298:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254035366c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265589.681171:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553796480 00000100:00100000:0.0:1789265589.681181:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553796480 00000100:00100000:0.0:1789265589.681213:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553796608 00000100:00100000:0.0:1789265589.681216:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553796608 00000100:00100000:0.0:1789265589.681248:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265589.681257:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553796480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265589.681302:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265589.681373:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553796480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265589.681381:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265589.681399:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265589.681406:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553796608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265589.681424:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265589.681460:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876180553796608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265589.681466:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789265589.681775:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265589.689846:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553796480:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789265589.689933:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925441a9fb80 x1876180553796608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265589.689950:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553796608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265589.694311:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553796736 00000100:00100000:3.0:1789265589.694327:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553796736 00000100:00100000:3.0:1789265589.694432:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265589.694450:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14331:x1876180553796736:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789265589.696953:0:14991:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789265589.696965:0:14991:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789265589.696970:0:14991:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1789265589.737705:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.737718:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.737735:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.737740:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.737747:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.737767:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.737778:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.737787:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.737972:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265589.737986:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265589.737993:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738012:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265589.738017:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738026:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738042:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738050:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3953edf/0x8e12577ef8190714 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738069:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.738071:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.738072:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265589.738564:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.738570:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738580:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.738583:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.738588:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738598:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738613:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738620:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738636:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265589.738645:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265589.738649:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738657:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884200 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265589.738661:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738669:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738679:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738686:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a14f93a/0x8e12577ef819071b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.738698:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.738704:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.738706:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265589.739247:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.739253:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739263:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.739266:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.739270:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739279:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739287:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739295:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739310:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265589.739318:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265589.739322:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739329:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265589.739352:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739372:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739386:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739394:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050a876c9/0x8e12577ef8190722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739412:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.739414:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.739416:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265589.739959:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.739966:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739976:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.739979:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.739984:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.739994:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740003:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740016:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740043:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265589.740671:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.740679:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740689:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.740693:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.740697:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740708:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740717:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740723:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740736:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265589.740745:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265589.740750:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740762:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265589.740767:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740776:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740789:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740944:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac620032/0x8e12577ef8190729 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740964:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265589.740968:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740975:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884e00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265589.740979:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740987:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.740999:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741013:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000163b429e/0x8e12577ef8190730 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741029:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.741031:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.741033:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265589.741547:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.741555:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741566:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.741569:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.741574:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741585:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741594:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741602:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741618:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265589.741626:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265589.741634:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741642:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265589.741645:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741653:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741665:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741672:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6b5a62e/0x8e12577ef8190737 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.741688:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.741690:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.741692:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265589.742373:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.742380:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742389:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.742392:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.742396:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742416:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742424:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742432:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742451:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265589.742885:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.742892:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742901:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.742904:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.742908:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742918:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742925:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742943:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.742952:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789265589.743084:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265589.743094:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743104:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.743108:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743117:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743136:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743145:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0baf0a9/0x8e12577ef819073e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743163:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265589.743166:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743172:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885c00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.743175:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743190:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743202:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743209:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe5a441d/0x8e12577ef8190745 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.743228:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.743230:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.743232:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265589.743327:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.743356:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743365:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.743368:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.743372:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743381:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743389:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743395:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743420:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265589.743764:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.743769:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743782:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.743785:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.743789:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743798:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743807:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.743813:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744007:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265589.744014:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744023:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.744027:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744035:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744047:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744066:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ee441a/0x8e12577ef819074c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744082:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.744083:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.744085:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.744125:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265589.744301:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265589.744306:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744314:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.744318:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744325:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744359:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.744368:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.744370:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.744371:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.750927:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c48d39f3/0x8e12577ef8190753 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265589.751668:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265589.751676:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751691:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789265589.751695:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265589.751702:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751727:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751738:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751746:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751768:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265589.751780:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265589.751786:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751794:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265589.751799:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751807:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751822:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.751846:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068cf4403/0x8e12577ef819075a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.759930:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265589.762220:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.762232:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.762263:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1789265589.762268:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.764021:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.764049:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.764060:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.764068:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.768563:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265589.769250:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.769260:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.769278:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.769282:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.769288:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.769305:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.769327:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.769365:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.769376:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265589.773522:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265589.774322:0:15926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265589.774360:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774383:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.774388:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774399:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774426:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774435:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ce73733/0x8e12577ef8190761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774461:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.774462:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.774465:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.774569:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.774574:0:15926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774581:0:15926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.774584:0:15926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774591:0:15926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774610:0:15926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774617:0:15926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bb37fa9/0x8e12577ef8190768 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.774641:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.774643:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.774645:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.774650:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.774652:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265589.777977:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.777989:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778006:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.778010:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.778017:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778032:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778043:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778050:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778098:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265589.778121:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265589.778128:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778136:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403136200 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.778140:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778149:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778167:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778174:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d690ffa/0x8e12577ef819076f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.778195:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.778197:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.778198:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265589.778682:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.778705:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265589.780975:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.780981:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265589.780983:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.782140:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.782155:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.782164:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.782181:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.782191:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.782198:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.782227:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265589.783200:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.783210:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.783222:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.783226:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.783230:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.783241:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.783250:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.783265:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.783302:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789265589.783712:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.783718:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.783727:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.783731:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265589.784972:0:15926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265589.784984:0:15926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.784996:0:15926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.785001:0:15926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785012:0:15926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785035:0:15926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785043:0:15926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4fe5618/0x8e12577ef8190776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785091:0:15926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265589.785095:0:15926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785101:0:15926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925403137600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.785104:0:15926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785110:0:15926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785120:0:15926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785126:0:15926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adac6205/0x8e12577ef819077d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.785138:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.785139:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.785141:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.785544:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.789040:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.789066:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.789079:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.789086:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.789121:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265589.789398:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265589.789406:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.789415:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400031600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.789427:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.789436:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.789454:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.789462:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8a2db01/0x8e12577ef8190784 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.789486:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.789488:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.789489:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265589.790547:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.790558:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.790581:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.790585:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.790590:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.790601:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.790611:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.790618:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.790680:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265589.791159:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.791165:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.791174:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.791178:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.791182:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.791192:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.791212:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.791220:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265589.799728:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265589.799752:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265589.799768:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265589.799773:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265589.799811:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265589.799851:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265589.799860:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007978db90/0x8e12577ef819078b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.800160:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265589.801094:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.801103:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.801119:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.801124:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.801129:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.801142:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.801151:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.801158:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.801199:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789265589.804114:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.804127:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.804144:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.804148:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.804154:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.804168:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.804177:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.804184:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.804212:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789265589.806522:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.806536:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.806550:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.806563:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.806569:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.806582:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.806591:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.806599:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.806610:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789265589.810627:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.810642:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.810660:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.810664:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.810670:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.810683:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.811184:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.811203:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817519:0:15927:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789265589.817536:0:15927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817551:0:15927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.817556:0:15927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817567:0:15927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817595:0:15927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817603:0:15927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086734602/0x8e12577ef8190792 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817636:0:15927:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265589.817640:0:15927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817645:0:15927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030e00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.817671:0:15927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817679:0:15927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817704:0:15927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817717:0:15927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ddfa400/0x8e12577ef8190799 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817738:0:15927:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265589.817742:0:15927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817748:0:15927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400031800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.817751:0:15927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817758:0:15927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817769:0:15927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817775:0:15927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007617a0c1/0x8e12577ef81907a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817797:0:15927:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265589.817802:0:15927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817808:0:15927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:2.0:1789265589.817812:0:15927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817819:0:15927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817840:0:15927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817848:0:15927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eca68eb/0x8e12577ef81907a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.817859:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.817861:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.817862:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.817881:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265589.818584:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.818593:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.818606:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.818617:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.818623:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.818637:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.818646:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.818653:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.818662:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789265589.819075:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.819081:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.819089:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.819092:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.819096:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.819105:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.819113:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.819127:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.819135:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789265589.820185:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789265589.820195:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820206:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400031400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.820210:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820221:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820239:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820256:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004841ba56/0x8e12577ef81907ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820291:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265589.820295:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820302:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.820305:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820313:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820324:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820347:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbcbd1ad/0x8e12577ef81907b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820360:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265589.820364:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820369:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400031a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.820378:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820386:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820397:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820404:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd38bfaa/0x8e12577ef81907bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.820418:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.820420:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.820422:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789265589.820531:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789265589.820560:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.821536:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.821540:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.821542:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.821869:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265589.822223:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.822234:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.822249:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.822254:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.822260:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.822274:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.823262:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.823271:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.824009:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265589.824645:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.824661:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.824678:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.824683:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.824704:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.824891:0:14294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265589.824900:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.824908:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030200 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.824912:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.824933:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.824951:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.824958:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cebdb71/0x8e12577ef81907c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.824979:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.824980:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.824982:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265589.825091:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.825100:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.825107:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.825128:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265589.828922:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265589.828935:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.828954:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789265589.828959:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265589.828965:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.828979:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.828997:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.829004:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265589.829021:0:14991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1789265589.829241:0:14991:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1789265589.829383:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14331:x1876180553796736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 134931us (149110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265589.829393:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789265589.829607:0:15926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265589.829617:0:15926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829626:0:15926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925400030000 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.829631:0:15926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829641:0:15926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829660:0:15926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829681:0:15926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e80fbc9/0x8e12577ef81907ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829718:0:15926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265589.829722:0:15926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829729:0:15926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677f600 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265589.829733:0:15926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829741:0:15926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829752:0:15926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829758:0:15926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef81907d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265589.829769:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.829771:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.829773:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265589.829780:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265589.830926:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14331:1876180553796736:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789265589.830945:0:14331:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789265589.831008:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437481f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14331:1876180553796864:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789265589.831061:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265589.831197:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254071b6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265589.836453:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553796864 00000100:00100000:1.0:1789265589.836469:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553796864 00000100:00100000:2.0:1789265589.836642:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265589.836654:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14331:x1876180553796864:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789265589.837033:0:14993:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789265589.845517:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14331:x1876180553796864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8857us (14447us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789265589.845529:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265589.845854:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437481f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14331:1876180553796864:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789265589.845869:0:14331:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1789265589.920580:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265590.954537:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265591.969356:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265592.847571:0:16066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789265593.002031:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265594.024860:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265594.783303:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553797248:0@lo:400:kworker.0 00000100:00100000:1.0:1789265594.783395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265594.783450:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265594.783457:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553797376:0@lo:400:kworker.0 00000100:00100000:1.0:1789265594.783483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265594.783519:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553797376 00000100:00100000:1.0:1789265594.783526:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553797376 00000100:00100000:1.0:1789265594.783576:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265594.783586:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553797376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265594.783637:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553797376:12345-0@lo:400:kworker.0 Request processed in 52us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265594.783644:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789265594.783685:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3e8380 x1876180553797376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265594.783698:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553797376:0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.786143:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553796992:0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.786208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265594.786250:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553797504:0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.786275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265594.786300:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265594.786306:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553797120:0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.786349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265594.786369:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553797632:0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.786388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265594.786434:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553796992 00000100:00100000:0.0:1789265594.786441:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553796992 00000100:00100000:0.0:1789265594.786486:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265594.786495:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553796992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.786552:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553796992:12345-0@lo:400:kworker.0 Request processed in 57us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265594.786559:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265594.786591:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553797504 00000100:00100000:0.0:1789265594.786595:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553797504 00000100:00100000:0.0:1789265594.786626:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553797632 00000100:00100000:0.0:1789265594.786628:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553797632 00000100:00100000:0.0:1789265594.786648:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265594.786654:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553797504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.786685:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553797504:12345-0@lo:400:kworker.0 Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265594.786691:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265594.786702:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265594.786707:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553797632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.786745:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553797632:12345-0@lo:400:kworker.0 Request processed in 23us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265594.786752:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789265594.786770:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265594.786783:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553797888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265594.786807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265594.786825:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265594.786830:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553797760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265594.786848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265594.786869:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553797888 00000100:00100000:0.0:1789265594.786873:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553797888 00000100:00100000:0.0:1789265594.786896:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553797760 00000100:00100000:0.0:1789265594.786898:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553797760 00000100:00100000:0.0:1789265594.786918:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265594.786923:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553797888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265594.786950:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265594.786986:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553797888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265594.786992:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265594.787003:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265594.787008:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876180553797760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265594.787025:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265594.787047:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876180553797760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265594.787052:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789265594.787067:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265594.787069:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265594.787379:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553797760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265594.787391:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92544185e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553797888:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789265594.787969:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3eb100 x1876180553797632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265594.787982:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553797632:0@lo:400:kworker.0 00000100:00100000:0.0:1789265594.787993:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553796992:0@lo:400:kworker.0 00010000:00080000:0.0:1789265594.788003:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92542b3eb800 x1876180553797504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265594.788012:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553797504:0@lo:400:kworker.0 00000100:00100000:2.0:1789265594.788231:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553797248 00000100:00100000:2.0:1789265594.788238:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553797248 00000100:00100000:2.0:1789265594.788276:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553797120 00000100:00100000:2.0:1789265594.788279:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553797120 00000100:00100000:2.0:1789265594.788297:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265594.788305:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553797248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265594.788379:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553797248:12345-0@lo:400:kworker.0 Request processed in 75us (4984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265594.788386:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265594.788411:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265594.788416:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553797120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265594.788446:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553797120:12345-0@lo:400:kworker.0 Request processed in 30us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265594.788452:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265594.788493:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553797248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265594.788516:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553797120:0@lo:400:kworker.0 00000001:00100000:0.0:1789265594.856521:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789265594.856551:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1789265595.039544:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265595.413078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265595.413604:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533878400 00000100:00100000:0.0:1789265595.413616:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533878400 00000100:00100000:0.0:1789265595.413677:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:0.0:1789265595.413685:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2341:x1876180533878400:12345-192.168.204.43@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789265595.413715:0:14301:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e4167d5b-7780-44cf-a6ba-cf4f934867bb@192.168.204.43@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1789265595.413759:0:14301:0:(genops.c:1385:class_connect()) connect: client e4167d5b-7780-44cf-a6ba-cf4f934867bb, cookie 0x8e12577ef81907d8 00000100:00080000:0.0:1789265595.413932:0:14301:0:(import.c:65:import_set_state_nolock()) ffff925441be8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265595.414011:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+5:2341:x1876180533878400:12345-192.168.204.43@tcp:250:mount.lustre.0 Request processed in 324us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265595.414020:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:0.0:1789265595.420133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265595.421660:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533878528 00000100:00100000:1.0:1789265595.421673:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533878528 00000100:00100000:1.0:1789265595.421759:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:1.0:1789265595.421771:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+5:13723:x1876180533878528:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265595.421786:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265595.421805:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925304271c00/0x8e12577ef81907df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f87bc expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.421856:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925304271c00/0x8e12577ef81907df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87bc expref: 6 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.421882:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925304271c00/0x8e12577ef81907df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87bc expref: 6 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.421893:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925304271c00, rc 0) 00000100:00100000:1.0:1789265595.421962:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+6:13723:x1876180533878528:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 193us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265595.421968:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:1.0:1789265595.427545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265595.427643:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533878656 00000100:00100000:2.0:1789265595.427654:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533878656 00000100:00100000:2.0:1789265595.427710:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:2.0:1789265595.427730:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+6:13723:x1876180533878656:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265595.428082:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+6:13723:x1876180533878656:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 363us (550us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265595.428093:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:3.0:1789265595.434992:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265595.435080:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533878784 00000100:00100000:0.0:1789265595.435092:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533878784 00000100:00100000:0.0:1789265595.435160:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:0.0:1789265595.435171:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+6:13723:x1876180533878784:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265595.435198:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265595.435374:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441995800/0x8e12577ef81907e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f87c3 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265595.435406:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441995800/0x8e12577ef81907e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87c3 expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265595.435419:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441995800/0x8e12577ef81907e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87c3 expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265595.435430:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995800, rc 0) 00000100:00100000:0.0:1789265595.435499:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+7:13723:x1876180533878784:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 330us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265595.435507:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:0.0:1789265595.438927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265595.439125:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533878912 00000100:00100000:2.0:1789265595.439136:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533878912 00000100:00100000:2.0:1789265595.439201:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:2.0:1789265595.439227:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+7:13723:x1876180533878912:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265595.440195:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+8:13723:x1876180533878912:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 965us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265595.440205:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:3.0:1789265595.442017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265595.442219:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533879040 00000100:00100000:0.0:1789265595.442234:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533879040 00000100:00100000:0.0:1789265595.442299:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:0.0:1789265595.442311:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+8:13723:x1876180533879040:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789265595.442872:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+8:13723:x1876180533879040:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 560us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265595.442882:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:3.0:1789265595.452406:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265595.452678:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533879168 00000100:00100000:2.0:1789265595.452702:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533879168 00000100:00100000:2.0:1789265595.452791:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:2.0:1789265595.452803:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+8:13741:x1876180533879168:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265595.453559:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+8:13741:x1876180533879168:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 751us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265595.453571:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:0.0:1789265595.476491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265595.477379:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533879296 00000100:00100000:2.0:1789265595.477394:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533879296 00000100:00100000:2.0:1789265595.477473:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:2.0:1789265595.477486:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+8:13741:x1876180533879296:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265595.477890:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+8:13741:x1876180533879296:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 404us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265595.477900:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:0.0:1789265595.494541:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265595.495103:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533879424 00000100:00100000:2.0:1789265595.495120:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533879424 00000100:00100000:2.0:1789265595.495208:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:2.0:1789265595.495221:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+8:13723:x1876180533879424:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265595.495245:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265595.495271:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92530677e200/0x8e12577ef81907ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f87ed expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265595.495376:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92530677e200/0x8e12577ef81907ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87ed expref: 9 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265595.495392:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92530677e200/0x8e12577ef81907ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87ed expref: 9 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265595.495404:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677e200, rc 0) 00000100:00100000:2.0:1789265595.495544:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+9:13723:x1876180533879424:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 324us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265595.495553:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:3.0:1789265595.510635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265595.510979:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533879552 00000100:00100000:1.0:1789265595.510992:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533879552 00000100:00100000:1.0:1789265595.511076:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:1.0:1789265595.511090:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+9:13723:x1876180533879552:12345-192.168.204.43@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789265595.511130:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789265595.511163:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789265595.511179:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789265595.511183:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789265595.511186:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789265595.515423:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+9:13723:x1876180533879552:12345-192.168.204.43@tcp:256:mount.lustre.0 Request processed in 4319us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265595.515443:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:0.0:1789265595.522951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265595.525437:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533879680 00000100:00100000:3.0:1789265595.525458:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533879680 00000100:00100000:3.0:1789265595.525552:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:3.0:1789265595.525564:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+9:13723:x1876180533879680:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265595.525586:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265595.525608:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f87f4 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265595.525646:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 10 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265595.525661:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 10 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265595.525672:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884000, rc 0) 00000100:00100000:3.0:1789265595.525771:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13723:x1876180533879680:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 208us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265595.525799:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:2.0:1789265595.543107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265595.543414:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533879808 00000100:00100000:0.0:1789265595.543443:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533879808 00000100:00100000:1.0:1789265595.543604:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:1.0:1789265595.543619:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13723:x1876180533879808:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265595.544093:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13723:x1876180533879808:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 475us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265595.544103:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:1.0:1789265595.560617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265595.560788:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533879936 00000100:00100000:0.0:1789265595.560804:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533879936 00000100:00100000:0.0:1789265595.560879:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:0.0:1789265595.560893:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543d4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13723:x1876180533879936:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789265595.570914:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543d4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13723:x1876180533879936:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 10005us (10305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265595.570946:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:0.0:1789265595.582003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265595.582160:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533880064 00000100:00100000:3.0:1789265595.582173:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533880064 00000100:00100000:3.0:1789265595.582248:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00100000:3.0:1789265595.582260:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13747:x1876180533880064:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265595.582689:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13747:x1876180533880064:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 419us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265595.582699:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00100000:2.0:1789265595.596667:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265595.596784:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533880192 00000100:00100000:1.0:1789265595.596799:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533880192 00000100:00100000:1.0:1789265595.596883:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:1.0:1789265595.596897:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13747:x1876180533880192:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265595.598832:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13747:x1876180533880192:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 1924us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265595.598848:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:0.0:1789265595.609967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265595.610168:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533880320 00000100:00100000:1.0:1789265595.610184:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533880320 00000100:00100000:1.0:1789265595.611416:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:1.0:1789265595.611440:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2341:x1876180533880320:12345-192.168.204.43@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789265595.611486:0:14308:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a1d40be9-5dee-4758-b282-460ebd8de52f@192.168.204.43@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1789265595.611555:0:14308:0:(genops.c:1385:class_connect()) connect: client a1d40be9-5dee-4758-b282-460ebd8de52f, cookie 0x8e12577ef81907fb 00000004:00100000:1.0:1789265595.611600:0:14308:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789265595.611609:0:14308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789265595.672849:0:14308:0:(import.c:65:import_set_state_nolock()) ffff92543ffe8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265595.672968:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2341:x1876180533880320:12345-192.168.204.43@tcp:38:mount.lustre.0 Request processed in 61528us (63013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265595.672983:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:0.0:1789265595.677731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265595.677770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265595.677970:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533880576 00000100:00100000:3.0:1789265595.677984:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533880576 00000100:00100000:3.0:1789265595.678075:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533880448 00000100:00100000:3.0:1789265595.678079:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533880448 00000100:00100000:3.0:1789265595.678098:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:3.0:1789265595.678111:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+7:13723:x1876180533880576:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265595.678181:0:14306:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1789265595.678468:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265595.678604:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+7:13723:x1876180533880576:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 495us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265595.678613:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:3.0:1789265595.678641:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:3.0:1789265595.678649:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+6:0:x1876180533880448:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265595.678662:0:14306:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789265595.678685:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+6:0:x1876180533880448:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 37us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265595.678692:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:0.0:1789265595.684273:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265595.684554:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533880704 00000100:00100000:3.0:1789265595.684568:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533880704 00000100:00100000:3.0:1789265595.684646:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:3.0:1789265595.684658:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13723:x1876180533880704:12345-192.168.204.43@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789265595.684790:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13723:x1876180533880704:12345-192.168.204.43@tcp:40:mount.lustre.0 Request processed in 133us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265595.684798:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:1.0:1789265595.690295:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265595.690584:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533880832 00000100:00100000:2.0:1789265595.690606:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533880832 00000100:00100000:2.0:1789265595.690670:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:2.0:1789265595.690681:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876180533880832:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265595.690734:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a1d40be9-5dee-4758-b282-460ebd8de52f@192.168.204.43@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1789265595.690777:0:14992:0:(genops.c:1385:class_connect()) connect: client a1d40be9-5dee-4758-b282-460ebd8de52f, cookie 0x8e12577ef8190802 00002000:00100000:2.0:1789265595.690793:0:14992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1d40be9-5dee-4758-b282-460ebd8de52f/ffff92530429d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265595.690807:0:14992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265595.692409:0:14992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265595.692536:0:14992:0:(import.c:65:import_set_state_nolock()) ffff92530429f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265595.692773:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2341:x1876180533880832:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 2087us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265595.692805:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1789265595.696876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265595.696936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265595.697050:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533880960 00000100:00100000:2.0:1789265595.697063:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533880960 00000100:00100000:2.0:1789265595.697119:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:2.0:1789265595.697129:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1876180533880960:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265595.697179:0:15719:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a1d40be9-5dee-4758-b282-460ebd8de52f@192.168.204.43@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1789265595.697218:0:15719:0:(genops.c:1385:class_connect()) connect: client a1d40be9-5dee-4758-b282-460ebd8de52f, cookie 0x8e12577ef8190809 00002000:00100000:2.0:1789265595.697233:0:15719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1d40be9-5dee-4758-b282-460ebd8de52f/ffff925304299800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265595.697248:0:15719:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265595.698531:0:15719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265595.698577:0:15719:0:(import.c:65:import_set_state_nolock()) ffff92530429b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265595.698897:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533881088 00000100:00100000:3.0:1789265595.698905:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533881088 00000100:00100000:3.0:1789265595.698957:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1789265595.698966:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13723:x1876180533881088:12345-192.168.204.43@tcp:33:mount.lustre.0 00000100:00100000:2.0:1789265595.699108:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2341:x1876180533880960:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 1978us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265595.699118:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000004:00080000:3.0:1789265595.716449:0:14309:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17394us 00000004:00200000:3.0:1789265595.756027:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789265595.756170:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13723:x1876180533881088:12345-192.168.204.43@tcp:33:mount.lustre.0 Request processed in 57199us (59226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265595.756182:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:0.0:1789265595.977301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265595.978017:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533881216 00000100:00100000:1.0:1789265595.978032:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533881216 00000100:00100000:1.0:1789265595.978203:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:1.0:1789265595.978217:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13768:x1876180533881216:12345-192.168.204.43@tcp:101:mkdir.0 00010000:00010000:1.0:1789265595.978244:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265595.978290:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925304271600/0x8e12577ef8190810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f881e expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.978406:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925304270600/0x8e12577ef8190817 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.978436:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925304270600/0x8e12577ef8190817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.978454:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925304270600/0x8e12577ef8190817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265595.978497:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265595.978500:0:14308:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265595.979009:0:14308:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925304270600/0x8e12577ef8190817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.979043:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925304271600/0x8e12577ef8190810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f881e expref: 8 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.979065:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925304270600/0x8e12577ef8190817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f881e expref: 7 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265595.979075:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9254053cb200) 00010000:00010000:1.0:1789265595.979079:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265595.979082:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925304270600, rc 0) 00000100:00100000:1.0:1789265595.979915:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+7:13768:x1876180533881216:12345-192.168.204.43@tcp:101:mkdir.0 Request processed in 1696us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265595.979944:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00010000:00010000:2.0:1789265596.064823:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265596.383103:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265597.087558:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265598.110604:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265598.313771:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.313940:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533881344 00000100:00100000:1.0:1789265598.313950:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533881344 00000100:00100000:1.0:1789265598.314030:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1789265598.314046:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+7:13820:x1876180533881344:12345-192.168.204.43@tcp:41:lfs.0 00000004:00000024:1.0:1789265598.314090:0:14307:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789265598.314192:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+7:13820:x1876180533881344:12345-192.168.204.43@tcp:41:lfs.0 Request processed in 153us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.314200:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00080000:2.0:1789265598.314363:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265598.320562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265598.320933:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533881472 00000100:00100000:2.0:1789265598.320945:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533881472 00000100:00100000:2.0:1789265598.321032:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1789265598.321043:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13820:x1876180533881472:12345-192.168.204.43@tcp:13:lfs.0 00002000:00000024:2.0:1789265598.321082:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265598.321234:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13820:x1876180533881472:12345-192.168.204.43@tcp:13:lfs.0 Request processed in 192us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265598.321243:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00080000:0.0:1789265598.322554:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265598.336439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265598.336686:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533881600 00000100:00100000:2.0:1789265598.336697:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533881600 00000100:00100000:2.0:1789265598.336776:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:2.0:1789265598.336792:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13820:x1876180533881600:12345-192.168.204.43@tcp:13:lfs.0 00002000:00000024:2.0:1789265598.336834:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265598.336930:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1d40be9-5dee-4758-b282-460ebd8de52f+6:13820:x1876180533881600:12345-192.168.204.43@tcp:13:lfs.0 Request processed in 145us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265598.336938:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00080000:0.0:1789265598.337745:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265598.530586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265598.530759:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533881728 00000100:00100000:2.0:1789265598.530769:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533881728 00000100:00100000:2.0:1789265598.530830:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 91 00000100:00100000:2.0:1789265598.530841:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+10:13851:x1876180533881728:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265598.530869:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265598.530889:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92530677e600/0x8e12577ef819081e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8825 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265598.530921:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92530677e600/0x8e12577ef819081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8825 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265598.530932:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92530677e600/0x8e12577ef819081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8825 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265598.530943:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677e600, rc 0) 00000100:00100000:2.0:1789265598.531005:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13851:x1876180533881728:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 166us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265598.531012:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 91 00000100:00100000:3.0:1789265598.545174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.545382:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533881856 00000100:00100000:1.0:1789265598.545397:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533881856 00000100:00100000:1.0:1789265598.545475:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:1.0:1789265598.545488:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13851:x1876180533881856:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265598.545902:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13851:x1876180533881856:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 416us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.545911:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:0.0:1789265598.554483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265598.554858:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533881984 00000100:00100000:3.0:1789265598.554874:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533881984 00000100:00100000:3.0:1789265598.554949:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:3.0:1789265598.554961:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13851:x1876180533881984:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265598.555304:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13851:x1876180533881984:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 344us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265598.555312:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:3.0:1789265598.589610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265598.590397:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533882112 00000100:00100000:2.0:1789265598.590428:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533882112 00000100:00100000:2.0:1789265598.590502:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:2.0:1789265598.590513:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13859:x1876180533882112:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265598.590903:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13859:x1876180533882112:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 390us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265598.590913:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:0.0:1789265598.634780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.634896:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533882240 00000100:00100000:1.0:1789265598.634912:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533882240 00000100:00100000:1.0:1789265598.634995:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 95 00000100:00100000:1.0:1789265598.635007:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13859:x1876180533882240:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265598.635681:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13859:x1876180533882240:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 674us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.635690:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 95 00000100:00100000:0.0:1789265598.650477:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265598.650848:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533882368 00000100:00100000:3.0:1789265598.650861:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533882368 00000100:00100000:3.0:1789265598.650932:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:3.0:1789265598.650943:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13851:x1876180533882368:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265598.650964:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265598.650987:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441884800/0x8e12577ef8190825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f884f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.651026:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441884800/0x8e12577ef8190825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f884f expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.651041:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441884800/0x8e12577ef8190825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f884f expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.651052:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884800, rc 0) 00000100:00100000:3.0:1789265598.651138:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13851:x1876180533882368:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 196us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265598.651146:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:3.0:1789265598.657056:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.657310:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533882496 00000100:00100000:1.0:1789265598.657371:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533882496 00000100:00100000:1.0:1789265598.657449:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:1.0:1789265598.657463:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13851:x1876180533882496:12345-192.168.204.43@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789265598.657502:0:14300:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789265598.657523:0:14300:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789265598.657528:0:14300:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789265598.657531:0:14300:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789265598.657533:0:14300:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789265598.659968:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13851:x1876180533882496:12345-192.168.204.43@tcp:256:mount.lustre.0 Request processed in 2491us (2912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.659986:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:0.0:1789265598.665188:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265598.665296:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533882624 00000100:00100000:2.0:1789265598.665308:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533882624 00000100:00100000:2.0:1789265598.665397:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:2.0:1789265598.665410:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543ca64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13851:x1876180533882624:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265598.665433:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265598.665460:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8856 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265598.665498:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265598.665511:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265598.665522:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677ee00, rc 0) 00000100:00100000:2.0:1789265598.665605:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543ca64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13851:x1876180533882624:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 198us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265598.665613:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:3.0:1789265598.667463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.667573:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533882752 00000100:00100000:1.0:1789265598.667584:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533882752 00000100:00100000:1.0:1789265598.667647:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:1.0:1789265598.667669:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925421200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13851:x1876180533882752:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265598.668055:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925421200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13851:x1876180533882752:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 397us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.668064:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:0.0:1789265598.670955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265598.671048:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533882880 00000100:00100000:3.0:1789265598.671060:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533882880 00000100:00100000:3.0:1789265598.671136:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:3.0:1789265598.671148:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925421201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13851:x1876180533882880:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265598.671494:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925421201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13851:x1876180533882880:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 347us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265598.671514:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:0.0:1789265598.681993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265598.682392:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533883008 00000100:00100000:2.0:1789265598.682408:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533883008 00000100:00100000:2.0:1789265598.682480:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:2.0:1789265598.682493:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13864:x1876180533883008:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265598.683181:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13864:x1876180533883008:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 686us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265598.683192:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:0.0:1789265598.692212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.692411:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533883136 00000100:00100000:1.0:1789265598.692425:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533883136 00000100:00100000:1.0:1789265598.692501:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:1.0:1789265598.692514:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13864:x1876180533883136:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265598.692888:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13864:x1876180533883136:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 377us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.692899:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:0.0:1789265598.707774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.709390:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533883264 00000100:00100000:1.0:1789265598.709431:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533883264 00000100:00100000:1.0:1789265598.709507:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:1.0:1789265598.709519:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2341:x1876180533883264:12345-192.168.204.43@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789265598.709572:0:14308:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8@192.168.204.43@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:1.0:1789265598.709623:0:14308:0:(genops.c:1385:class_connect()) connect: client b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8, cookie 0x8e12577ef8190833 00000004:00100000:1.0:1789265598.709674:0:14308:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789265598.710375:0:14308:0:(import.c:65:import_set_state_nolock()) ffff92543ffe8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265598.712237:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2341:x1876180533883264:12345-192.168.204.43@tcp:38:mount.lustre.0 Request processed in 2704us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.712253:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1789265598.729883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265598.730029:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533883520 00000100:00100000:3.0:1789265598.730043:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533883520 00000100:00100000:3.0:1789265598.730157:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:3.0:1789265598.730170:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:13851:x1876180533883520:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265598.730216:0:14306:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789265598.730316:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:13851:x1876180533883520:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 149us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265598.730325:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00080000:0.0:1789265598.730470:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265598.737007:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.737257:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533883392 00000100:00100000:1.0:1789265598.737272:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533883392 00000100:00100000:1.0:1789265598.737388:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:1.0:1789265598.737404:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:0:x1876180533883392:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265598.737458:0:14308:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789265598.737572:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:0:x1876180533883392:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 173us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.737581:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1789265598.744604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.744934:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533883648 00000100:00100000:1.0:1789265598.744948:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533883648 00000100:00100000:1.0:1789265598.745032:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1789265598.745044:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:13851:x1876180533883648:12345-192.168.204.43@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789265598.745229:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:13851:x1876180533883648:12345-192.168.204.43@tcp:40:mount.lustre.0 Request processed in 186us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.745239:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:0.0:1789265598.753408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265598.753561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265598.753604:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265598.753898:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533883776 00000100:00100000:1.0:1789265598.753913:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533883776 00000100:00100000:1.0:1789265598.753967:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533883904 00000100:00100000:1.0:1789265598.753970:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533883904 00000100:00100000:1.0:1789265598.753995:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:1.0:1789265598.754004:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876180533883776:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789265598.754048:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8@192.168.204.43@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:1.0:1789265598.754096:0:14992:0:(genops.c:1385:class_connect()) connect: client b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8, cookie 0x8e12577ef819083a 00002000:00100000:1.0:1789265598.754123:0:14992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8/ffff92543ffef800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789265598.754138:0:14992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789265598.754293:0:14992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789265598.754358:0:14992:0:(import.c:65:import_set_state_nolock()) ffff92543ffec800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265598.754444:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2341:x1876180533883776:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 440us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.754453:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:1.0:1789265598.754475:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:1.0:1789265598.754481:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876180533883904:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789265598.754496:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8@192.168.204.43@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:1.0:1789265598.754517:0:14992:0:(genops.c:1385:class_connect()) connect: client b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8, cookie 0x8e12577ef8190841 00002000:00100000:1.0:1789265598.754523:0:14992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8/ffff92543ffed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789265598.754530:0:14992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789265598.754602:0:14992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789265598.754624:0:14992:0:(import.c:65:import_set_state_nolock()) ffff92543ffe9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265598.754650:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2341:x1876180533883904:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 168us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265598.754695:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:2.0:1789265598.756895:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533884032 00000100:00100000:2.0:1789265598.756917:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533884032 00000100:00100000:2.0:1789265598.757053:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:2.0:1789265598.757067:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:13851:x1876180533884032:12345-192.168.204.43@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789265598.757199:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789265598.757360:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:13851:x1876180533884032:12345-192.168.204.43@tcp:33:mount.lustre.0 Request processed in 266us (3938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265598.757369:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00000001:00100000:0.0:1789265598.981284:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8 00000001:00100000:0.0:1789265598.981307:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1d40be9-5dee-4758-b282-460ebd8de52f 00000100:00100000:1.0:1789265598.991893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265598.991995:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533884160 00000100:00100000:3.0:1789265598.992010:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533884160 00000100:00100000:3.0:1789265598.992087:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:3.0:1789265598.992109:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:13885:x1876180533884160:12345-192.168.204.43@tcp:101:mkdir.0 00010000:00010000:3.0:1789265598.992145:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265598.992177:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885a00/0x8e12577ef8190848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8880 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.992265:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.992284:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.992302:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265598.992371:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265598.992388:0:14306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265598.992419:0:14306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.992451:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885a00/0x8e12577ef8190848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 8 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.992471:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 7 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265598.992481:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9254053cb200) 00010000:00010000:3.0:1789265598.992484:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265598.992489:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:3.0:1789265598.992791:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+7:13885:x1876180533884160:12345-192.168.204.43@tcp:101:mkdir.0 Request processed in 692us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265598.992799:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00010000:00010000:1.0:1789265599.135104:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265599.905092:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553798016:0@lo:400:kworker.0 00000100:00100000:1.0:1789265599.905121:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553798272:0@lo:400:kworker.0 00000100:00100000:3.0:1789265599.905306:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553798144:0@lo:400:kworker.0 00000100:00100000:1.0:1789265599.908611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265599.908721:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265599.908736:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553798400:0@lo:400:kworker.0 00000100:00100000:1.0:1789265599.908790:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265599.908846:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553798272 00000100:00100000:1.0:1789265599.908856:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553798272 00000100:00100000:1.0:1789265599.908931:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265599.908946:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553798272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265599.909028:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553798272:12345-0@lo:400:kworker.0 Request processed in 88us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265599.909036:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265599.909063:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553798400 00000100:00100000:1.0:1789265599.909067:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553798400 00000100:00100000:1.0:1789265599.909095:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265599.909103:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553798400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265599.909947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265599.910070:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553798528:0@lo:400:kworker.0 00000100:00100000:2.0:1789265599.910192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265599.910307:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553798016 00000100:00100000:2.0:1789265599.910314:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553798016 00000100:00100000:2.0:1789265599.910373:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265599.910382:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553798016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265599.910433:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553798016:12345-0@lo:400:kworker.0 Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265599.910440:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265599.910501:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553798016:0@lo:400:kworker.0 00000100:00100000:2.0:1789265599.910747:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265599.910814:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789265599.910956:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553798528 00000100:00100000:2.0:1789265599.910960:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553798528 00000100:00100000:2.0:1789265599.910987:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265599.910994:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265599.911001:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553798528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265599.911197:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553798528:12345-0@lo:400:kworker.0 Request processed in 196us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265599.911329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265599.911397:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553798144 00000100:00100000:3.0:1789265599.911401:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553798144 00000100:00100000:3.0:1789265599.911437:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265599.911444:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553798144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265599.911477:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553798144:12345-0@lo:400:kworker.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265599.911483:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265599.911964:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265599.912170:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553798528:0@lo:400:kworker.0 00000100:00100000:3.0:1789265599.912275:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553798144:0@lo:400:kworker.0 00000100:00100000:2.0:1789265599.913372:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553798656:0@lo:400:kworker.0 00000100:00100000:2.0:1789265599.913446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265599.913481:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553798656 00000100:00100000:2.0:1789265599.913489:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553798656 00000100:00080000:1.0:1789265599.913586:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265599.913593:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265599.913596:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265599.913642:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553798912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265599.913682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265599.913714:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265599.913721:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553798784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265599.913755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265599.913784:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553798912 00000100:00100000:1.0:1789265599.913788:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553798912 00000100:00100000:1.0:1789265599.913819:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553798784 00000100:00100000:1.0:1789265599.913822:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553798784 00000100:00100000:1.0:1789265599.913838:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265599.913848:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553798912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265599.913893:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265599.913941:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553798912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265599.913948:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265599.913965:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265599.913971:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553798784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265599.913992:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265599.914171:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265599.914179:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553798656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265599.914615:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553798656:12345-0@lo:400:kworker.0 Request processed in 436us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265599.914623:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265599.914874:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553798656:0@lo:400:kworker.0 00000100:00100000:1.0:1789265599.915774:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876180553798784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1800us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265599.915785:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265599.915851:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553798784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265599.915864:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789265599.915885:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553798912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265599.915919:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553798272:0@lo:400:kworker.0 00000100:00100000:1.0:1789265599.915970:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553798400:12345-0@lo:400:kworker.0 Request processed in 6868us (7179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265599.915979:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265599.917141:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553798400:0@lo:400:kworker.0 00000001:00100000:2.0:1789265600.007495:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8 00000001:00100000:2.0:1789265600.007585:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1d40be9-5dee-4758-b282-460ebd8de52f 00010000:00010000:1.0:1789265600.163993:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789265601.075195:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8 00000001:00100000:1.0:1789265601.075219:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1d40be9-5dee-4758-b282-460ebd8de52f 00010000:00010000:1.0:1789265601.194689:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265602.210164:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265603.121934:0:16275:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789265603.240286:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265604.219565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265604.219620:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265604.219678:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265604.219702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265604.219724:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265604.219743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265604.219775:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265604.219805:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533884544 00000100:00100000:2.0:1789265604.219821:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533884544 00000100:00100000:2.0:1789265604.219891:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533885056 00000100:00100000:2.0:1789265604.219895:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533885056 00000100:00100000:2.0:1789265604.219916:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533884672 00000100:00100000:2.0:1789265604.219919:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533884672 00000100:00100000:2.0:1789265604.219930:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533884928 00000100:00100000:2.0:1789265604.219932:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533884928 00000100:00100000:2.0:1789265604.219952:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1789265604.219965:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2344:x1876180533884544:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265604.220266:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:1.0:1789265604.220278:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2344:x1876180533885056:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265604.220386:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2344:x1876180533885056:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 110us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265604.220394:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:1.0:1789265604.220448:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:1.0:1789265604.220457:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2344:x1876180533884672:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265604.220482:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2344:x1876180533884672:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 27us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265604.220489:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:1.0:1789265604.220503:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1789265604.220510:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2344:x1876180533884928:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265604.220562:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2344:x1876180533884928:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 52us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265604.220568:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1789265604.220610:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533884800 00000100:00100000:1.0:1789265604.220615:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533884800 00000100:00100000:3.0:1789265604.220632:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533884288 00000100:00100000:3.0:1789265604.220649:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533884288 00000100:00100000:1.0:1789265604.220651:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533884416 00000100:00100000:1.0:1789265604.220653:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533884416 00000100:00100000:1.0:1789265604.220674:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:1.0:1789265604.220680:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2344:x1876180533884800:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265604.220682:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:3.0:1789265604.220688:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:2344:x1876180533884288:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265604.220721:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2344:x1876180533884800:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 36us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265604.220729:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:1.0:1789265604.220743:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:1.0:1789265604.220750:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2344:x1876180533884416:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1789265604.227405:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:2344:x1876180533884288:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 5739us (6889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265604.227427:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00080000:0.0:1789265604.231516:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265604.231543:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265604.231557:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265604.232609:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2344:x1876180533884416:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 11842us (12865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265604.232629:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1789265604.233311:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2344:x1876180533884544:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 13342us (13682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265604.233324:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00010000:00010000:1.0:1789265604.255473:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265605.023729:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553799040:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.023835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265605.023896:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553799552:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.023929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265605.023959:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265605.023965:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553799168:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.024181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265605.024217:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553799680:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.024242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265605.025922:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553799296:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.026013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265605.026213:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553799808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265605.026247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265605.026287:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265605.026296:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553799424:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.027458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265605.027498:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265605.027514:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553799936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265605.027559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265605.027609:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553799040 00000100:00100000:0.0:1789265605.027620:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553799040 00000100:00100000:0.0:1789265605.027677:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265605.027686:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553799040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.027750:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553799040:12345-0@lo:400:kworker.0 Request processed in 65us (3916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265605.027759:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265605.027816:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553799552 00000100:00100000:0.0:1789265605.027821:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553799552 00000100:00100000:0.0:1789265605.027860:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553799680 00000100:00100000:0.0:1789265605.027863:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553799680 00000100:00100000:0.0:1789265605.027879:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553799424 00000100:00100000:0.0:1789265605.027881:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553799424 00000100:00100000:0.0:1789265605.027895:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265605.027903:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553799552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.027940:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553799552:12345-0@lo:400:kworker.0 Request processed in 40us (4011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265605.027947:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265605.027958:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265605.027965:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553799680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.028008:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553799680:12345-0@lo:400:kworker.0 Request processed in 44us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265605.028014:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265605.028038:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265605.028044:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553799424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.028080:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553799424:12345-0@lo:400:kworker.0 Request processed in 36us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265605.028086:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265605.028110:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553799168 00000100:00100000:0.0:1789265605.028114:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553799168 00000100:00100000:0.0:1789265605.028143:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553799296 00000100:00100000:0.0:1789265605.028157:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553799296 00000100:00100000:0.0:1789265605.028188:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265605.028829:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553799168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.028892:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553799168:12345-0@lo:400:kworker.0 Request processed in 697us (4711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265605.028907:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265605.028929:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265605.028937:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553799296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.028970:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553799296:12345-0@lo:400:kworker.0 Request processed in 35us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265605.029275:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265605.029402:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553799808 00000100:00100000:0.0:1789265605.029409:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553799808 00000100:00100000:0.0:1789265605.029512:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553799936 00000100:00100000:0.0:1789265605.029517:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553799936 00000100:00100000:0.0:1789265605.029530:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265605.029549:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553799808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265605.029594:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265605.029652:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553799808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (3403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265605.029659:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265605.029671:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265605.029677:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553799936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265605.030722:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265605.030807:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553799936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1126us (3243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265605.030816:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265605.030907:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553799168:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.030925:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553799680:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.030940:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553799040:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.030972:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553799552:0@lo:400:kworker.0 00000100:00080000:0.0:1789265605.031399:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265605.031408:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265605.031413:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265605.031558:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553799936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265605.031767:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553799424:0@lo:400:kworker.0 00000100:00100000:0.0:1789265605.031791:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553799808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265605.031803:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553799296:0@lo:400:kworker.0 00010000:00010000:1.0:1789265605.278494:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265606.302578:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265606.624254:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1789265606.925092:0:16423:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe116d7000 20000000:00000080:1.0:1789265606.925119:0:16423:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff925307fe9000 uarg=0000000000000000 20000000:01000000:1.0:1789265606.925175:0:16423:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265606.925184:0:16423:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265606.925191:0:16423:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789265606.926617:0:16424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1789265606.926866:0:16423:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789265606.937865:0:16423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265606.937907:0:16423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.937932:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190546 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.937941:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190593 expref: 18 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938017:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938028:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938035:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938043:0:16423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938127:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938146:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 12 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265606.938166:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800064:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265606.938441:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938451:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 12 pid: 14301 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265606.938461:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800192:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265606.938526:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938535:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 18 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265606.938546:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800320:0@lo:104: 00000100:00100000:3.0:1789265606.938600:0:16423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265606.938647:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef8190593 expref: 18 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938656:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef8190593 expref: 18 pid: 14300 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265606.938678:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800448:0@lo:104: 00000100:00100000:3.0:1789265606.938704:0:16423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265606.938734:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e12577ef8190546 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.938743:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e12577ef8190546 expref: 18 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265606.938751:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800576:0@lo:104: 00000100:00100000:3.0:1789265606.938775:0:16423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265606.938785:0:16423:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403536c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265606.939116:0:14289:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789265606.939137:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553800320 00000100:00100000:1.0:1789265606.939147:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553800320 00000100:00100000:1.0:1789265606.939197:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553800448 00000100:00100000:1.0:1789265606.939199:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553800448 00000100:00100000:1.0:1789265606.939209:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553800576 00000100:00100000:1.0:1789265606.939211:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553800576 00000100:00100000:1.0:1789265606.939225:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265606.939236:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+5:16423:x1876180553800320:12345-0@lo:104: 00010000:00010000:1.0:1789265606.939253:0:14289:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939360:0:14289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265606.939366:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+5:16423:x1876180553800320:12345-0@lo:104: Request processed in 133us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265606.939374:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265606.939396:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265606.939569:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+4:16423:x1876180553800448:12345-0@lo:104: 00010000:00010000:1.0:1789265606.939579:0:14289:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939621:0:14289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265606.939626:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+4:16423:x1876180553800448:12345-0@lo:104: Request processed in 225us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265606.939633:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265606.939647:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265606.939653:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:16423:x1876180553800576:12345-0@lo:104: 00010000:00010000:1.0:1789265606.939661:0:14289:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939693:0:14289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789265606.939699:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+3:16423:x1876180553800576:12345-0@lo:104: Request processed in 47us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265606.939705:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789265606.939750:0:15926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789265606.939759:0:15926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939780:0:15926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885400 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1789265606.939786:0:15926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939796:0:15926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265606.939805:0:15926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265606.939813:0:15926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265606.939860:0:15926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939868:0:15926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265606.939899:0:15926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939907:0:15926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925441885400/0x8e12577ef81906c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef81906ce expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939924:0:15926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265606.939928:0:15926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939934:0:15926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884c00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1789265606.939937:0:15926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.939971:0:15926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265606.939978:0:15926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265606.939983:0:15926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265606.939997:0:15926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.940004:0:15926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265606.940011:0:15926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.940018:0:15926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff925441884c00/0x8e12577ef8190593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef819059a expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.940028:0:15926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265606.940032:0:15926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.940038:0:15926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92543bc5ee00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1789265606.940041:0:15926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.940048:0:15926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265606.940054:0:15926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265606.940065:0:15926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265606.940080:0:15926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.940086:0:15926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265606.940102:0:15926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.940109:0:15926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff92543bc5ee00/0x8e12577ef8190546 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e12577ef819054d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265606.940123:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265606.940125:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265606.940127:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265606.940135:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265606.940233:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553800832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265606.940287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265606.940365:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265606.940372:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553800704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265606.940397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265606.940463:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553800832 00000100:00100000:2.0:1789265606.940560:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553800832 00010000:00010000:2.0:1789265606.940594:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef8190593 expref: 19 pid: 14300 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265606.940639:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553800704 00000100:00100000:2.0:1789265606.940643:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553800704 00010000:00010000:2.0:1789265606.940659:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 20 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265606.940676:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265606.940685:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+20:3305:x1876180553800832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265606.940701:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265606.940708:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef8190593 expref: 20 pid: 14300 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.940719:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef8190593 expref: 20 pid: 14300 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.940746:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265606.940783:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+20:3305:x1876180553800832:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265606.940791:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265606.940809:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265606.940816:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3305:x1876180553800704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265606.940824:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265606.940828:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 19 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.940837:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 19 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.940848:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265606.940876:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3305:x1876180553800704:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265606.940883:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265606.940932:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553800704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265606.940944:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553800832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265606.941406:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925403136400/0x8e12577ef81906ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef81906c7 expref: 18 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265606.941422:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800320:0@lo:104: 00010000:00010000:3.0:1789265606.941438:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92543bc5fa00/0x8e12577ef819059a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef8190593 expref: 17 pid: 14300 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265606.941447:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800448:0@lo:104: 00000100:00100000:3.0:1789265606.941459:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800576:0@lo:104: 00010000:00010000:1.0:1789265606.942869:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265606.943173:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3306:1876180553800960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265606.943251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265606.943443:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553800960 00000100:00100000:2.0:1789265606.943451:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553800960 00010000:00010000:2.0:1789265606.943661:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef8190546 expref: 17 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265606.943713:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265606.943724:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441345050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:3306:x1876180553800960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265606.943742:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265606.943748:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e12577ef8190546 expref: 17 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.943760:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e12577ef8190546 expref: 17 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.943782:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441885000/0x8e12577ef819054d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e12577ef8190546 expref: 17 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.943799:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265606.943858:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441345050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:3306:x1876180553800960:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265606.943866:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265606.944032:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3306:1876180553800960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265606.946763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265606.946808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265606.947655:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800064:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265606.947674:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1876180553800192:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265606.947734:0:16423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265606.949233:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533885184 00000100:00100000:0.0:1789265606.949254:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533885184 00010000:00010000:0.0:1789265606.949383:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 13 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265606.949564:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533885312 00000100:00100000:0.0:1789265606.949570:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533885312 00010000:00010000:0.0:1789265606.949587:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 14 pid: 14301 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265606.949605:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:0.0:1789265606.949615:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+14:2342:x1876180533885184:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265606.949633:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265606.949638:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 14 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265606.949667:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 14 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265606.949686:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92530677ee00/0x8e12577ef819082c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8856 expref: 14 pid: 14298 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265606.949705:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265606.949769:0:14291:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789265606.949781:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789265606.950019:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:3.0:1789265606.950036:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:2342:x1876180533885312:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265606.950047:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265606.950053:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 13 pid: 14301 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265606.950067:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:2342:x1876180533885184:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 450us (3317us total) trans 0 rc 0/0 00010000:00010000:3.0:1789265606.950072:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 13 pid: 14301 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265606.950080:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00010000:00010000:3.0:1789265606.950093:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441884000/0x8e12577ef81907f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f87f4 expref: 13 pid: 14301 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950110:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950121:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950139:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950148:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950157:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950165:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950173:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884400 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:3.0:1789265606.950178:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950194:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950221:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265606.950235:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265606.950273:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:2342:x1876180533885312:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 240us (3465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265606.950281:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00010000:00010000:2.0:1789265606.951002:0:16423:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.951030:0:16423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265606.951037:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925441884400/0x8e12577ef8190856 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265607.327605:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265608.223046:0:14303:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265608.223053:0:14303:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92542d5f8000 from 10 10000000:01000000:2.0:1789265608.223057:0:14303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265608.223105:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff92530677ec00/0x8e12577ef819085d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265608.223117:0:14303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff92530677ec00/0x8e12577ef819085d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265608.223128:0:14303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff92530677ec00/0x8e12577ef819085d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265608.223155:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265608.223225:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265608.223282:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437043b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265608.223407:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553801088 00000100:00100000:3.0:1789265608.223416:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553801088 00000100:00100000:3.0:1789265608.223461:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265608.223481:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+16:14303:x1876180553801088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265608.223494:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265608.223511:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441885a00/0x8e12577ef8190864 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef819085d expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.223535:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441885a00/0x8e12577ef8190864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef819085d expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.223545:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441885a00/0x8e12577ef8190864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef819085d expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.223554:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885a00, rc 0) 00000100:00100000:3.0:1789265608.223601:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:14303:x1876180553801088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265608.223619:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789265608.223936:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265608.223951:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff92530677ec00/0x8e12577ef819085d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190864 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265608.223961:0:14303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff92530677ec00/0x8e12577ef819085d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190864 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265608.224022:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265608.224062:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265608.224096:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437043b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265608.224141:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553801216 00000100:00100000:3.0:1789265608.224147:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553801216 00000100:00100000:3.0:1789265608.224178:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789265608.224185:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:14303:x1876180553801216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265608.224619:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:14303:x1876180553801216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265608.224626:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789265608.224698:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.224738:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.224778:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265608.224811:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403e620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265608.224946:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553801344 00000100:00100000:2.0:1789265608.224951:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553801344 00000100:00100000:2.0:1789265608.224988:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789265608.224997:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:14303:x1876180553801344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265608.225167:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:14303:x1876180553801344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265608.225173:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265608.225307:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265608.226719:0:16492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789265608.226936:0:14303:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789265608.226963:0:14303:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265608.226974:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff92530677ec00/0x8e12577ef819085d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190864 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.226986:0:14303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff92530677ec00/0x8e12577ef819085d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190864 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265608.226997:0:14303:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265608.227000:0:14303:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925404c95800 from 10 10000000:01000000:1.0:1789265608.227003:0:14303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265608.227037:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925304271600/0x8e12577ef819086b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.227045:0:14303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925304271600/0x8e12577ef819086b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.227056:0:14303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925304271600/0x8e12577ef819086b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265608.227077:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.227136:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265608.227171:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925403e620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265608.227622:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553801472 00000100:00100000:2.0:1789265608.227630:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553801472 00000100:00100000:2.0:1789265608.227681:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789265608.227692:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+17:14303:x1876180553801472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265608.227707:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265608.227722:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92530677f200/0x8e12577ef8190872 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef819086b expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265608.227745:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92530677f200/0x8e12577ef8190872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef819086b expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265608.227756:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92530677f200/0x8e12577ef8190872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef819086b expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265608.227765:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677f200, rc 0) 00000100:00100000:2.0:1789265608.227816:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:14303:x1876180553801472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265608.227823:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265608.228113:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265608.228130:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925304271600/0x8e12577ef819086b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190872 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.228140:0:14303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925304271600/0x8e12577ef819086b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190872 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265608.228217:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265608.228248:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265608.228282:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265608.228648:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553801600 00000100:00100000:1.0:1789265608.228654:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553801600 00000100:00100000:1.0:1789265608.228697:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789265608.228706:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:14303:x1876180553801600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.229595:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:14303:x1876180553801600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 882us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265608.229616:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789265608.229747:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265608.229801:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265608.229845:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265608.229873:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437043780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265608.232007:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553801728 00000100:00100000:1.0:1789265608.232023:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553801728 00000100:00100000:1.0:1789265608.232092:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789265608.232103:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:14303:x1876180553801728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.232656:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:14303:x1876180553801728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 552us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265608.232665:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265608.236231:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265608.240227:0:16494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789265608.240723:0:14303:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789265608.240758:0:14303:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265608.240770:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925304271600/0x8e12577ef819086b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190872 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.240782:0:14303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925304271600/0x8e12577ef819086b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190872 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265608.240808:0:14303:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265608.240810:0:14303:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92543bbd7000 from 10 10000000:01000000:3.0:1789265608.240813:0:14303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265608.240850:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441884000/0x8e12577ef8190879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.240858:0:14303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff925441884000/0x8e12577ef8190879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.240869:0:14303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff925441884000/0x8e12577ef8190879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265608.240896:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265608.240983:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265608.241020:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265608.241119:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553801856 00000100:00100000:1.0:1789265608.241128:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553801856 00000100:00100000:1.0:1789265608.241193:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789265608.241205:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+18:14303:x1876180553801856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265608.241220:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265608.241236:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925304271000/0x8e12577ef8190880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e12577ef8190879 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.241260:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925304271000/0x8e12577ef8190880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e12577ef8190879 expref: 19 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.241271:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925304271000/0x8e12577ef8190880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e12577ef8190879 expref: 19 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.241279:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925304271000, rc 0) 00000100:00100000:1.0:1789265608.241528:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:14303:x1876180553801856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265608.241537:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789265608.241601:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265608.241615:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff925441884000/0x8e12577ef8190879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190880 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.241624:0:14303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff925441884000/0x8e12577ef8190879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e12577ef8190880 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265608.241690:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.241715:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265608.241737:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540715bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265608.241750:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553801984 00000100:00100000:1.0:1789265608.241753:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553801984 00000100:00100000:1.0:1789265608.241774:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789265608.241781:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:14303:x1876180553801984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.242049:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:14303:x1876180553801984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265608.242056:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789265608.242095:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553801984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.242122:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553802112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.242172:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265608.242184:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff92540715bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265608.242194:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553802112 00000100:00100000:1.0:1789265608.242198:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553802112 00000100:00100000:1.0:1789265608.242217:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789265608.242223:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:14303:x1876180553802112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.243602:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:14303:x1876180553802112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1372us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265608.243625:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789265608.243700:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c79c9cb-ef4c-488b-80e5-fba066317ec7:14303:1876180553802112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265608.245789:0:16495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789265608.250258:0:14303:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789265608.250367:0:14303:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265608.250381:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff925441884000/0x8e12577ef8190879 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190880 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265608.250395:0:14303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff925441884000/0x8e12577ef8190879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e12577ef8190880 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265608.352663:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265608.373319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265608.374082:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533885440 00000100:00100000:3.0:1789265608.374097:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533885440 00000100:00100000:3.0:1789265608.374240:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:3.0:1789265608.374252:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+11:13737:x1876180533885440:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265608.374274:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265608.374299:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925441884600/0x8e12577ef8190887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8887 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.375288:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925441884600/0x8e12577ef8190887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8887 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.375312:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925441884600/0x8e12577ef8190887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8887 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265608.375347:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884600, rc 0) 00000100:00100000:3.0:1789265608.375429:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13737:x1876180533885440:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 1178us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265608.375438:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:0.0:1789265608.390142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265608.390236:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533885568 00000100:00100000:1.0:1789265608.390248:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533885568 00000100:00100000:1.0:1789265608.390315:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:1.0:1789265608.390326:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13737:x1876180533885568:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265608.390714:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13737:x1876180533885568:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 388us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265608.390722:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:0.0:1789265608.396039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265608.396304:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533885696 00000100:00100000:3.0:1789265608.396317:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533885696 00000100:00100000:3.0:1789265608.396746:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:3.0:1789265608.396758:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13737:x1876180533885696:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265608.397276:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13737:x1876180533885696:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 517us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265608.397286:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:0.0:1789265608.416057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265608.418200:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533885824 00000100:00100000:1.0:1789265608.418218:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533885824 00000100:00100000:1.0:1789265608.418290:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:1.0:1789265608.418301:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+12:13737:x1876180533885824:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265608.418321:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265608.418355:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925304271e00/0x8e12577ef819088e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f888e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.421825:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925304271e00/0x8e12577ef819088e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f888e expref: 13 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.421848:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925304271e00/0x8e12577ef819088e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f888e expref: 13 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265608.421860:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925304271e00, rc 0) 00000100:00100000:1.0:1789265608.422243:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13737:x1876180533885824:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 3941us (6192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265608.422252:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:0.0:1789265608.428811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265608.428862:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533885952 00000100:00100000:0.0:1789265608.428875:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533885952 00000100:00100000:0.0:1789265608.428948:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:0.0:1789265608.428968:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13737:x1876180533885952:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265608.429289:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13737:x1876180533885952:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 320us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265608.429298:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:3.0:1789265608.442733:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265608.442779:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533886080 00000100:00100000:3.0:1789265608.442791:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533886080 00000100:00100000:3.0:1789265608.442853:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:3.0:1789265608.442867:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13737:x1876180533886080:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265608.443129:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:13737:x1876180533886080:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 265us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265608.443141:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:0.0:1789265609.333576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265609.333640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265609.333693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265609.333802:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533886464 00000100:00100000:2.0:1789265609.333817:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533886464 00000100:00100000:2.0:1789265609.333924:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1789265609.333938:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2342:x1876180533886464:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265609.334066:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2342:x1876180533886464:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 130us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265609.334075:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00080000:2.0:1789265609.334313:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265609.334635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265609.334680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265609.334727:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533886976 00000100:00100000:2.0:1789265609.334734:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533886976 00000100:00100000:2.0:1789265609.334776:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:2.0:1789265609.334783:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2342:x1876180533886976:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265609.334827:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2342:x1876180533886976:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265609.334834:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00080000:2.0:1789265609.334858:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265609.335353:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533886208 00000100:00100000:1.0:1789265609.335361:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533886208 00000100:00100000:1.0:1789265609.335411:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:1.0:1789265609.335420:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:2342:x1876180533886208:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265609.335475:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:2342:x1876180533886208:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 49us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265609.335483:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:3.0:1789265609.338672:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533886720 00000100:00100000:3.0:1789265609.338695:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533886720 00000100:00080000:2.0:1789265609.338822:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265609.338904:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533886336 00000100:00100000:3.0:1789265609.338909:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533886336 00000100:00100000:0.0:1789265609.338929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265609.338966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265609.339178:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533886592 00000100:00100000:0.0:1789265609.339182:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533886592 00000100:00100000:0.0:1789265609.339216:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533886848 00000100:00100000:0.0:1789265609.339218:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533886848 00000100:00100000:0.0:1789265609.339242:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:0.0:1789265609.339252:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2342:x1876180533886592:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265609.339568:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2342:x1876180533886592:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 316us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265609.339577:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:0.0:1789265609.339597:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1789265609.339605:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2342:x1876180533886848:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265609.339634:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2342:x1876180533886848:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265609.339641:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00080000:0.0:1789265609.339952:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265609.339958:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265609.339961:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265609.344593:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:2.0:1789265609.344629:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2342:x1876180533886720:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265609.344775:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2342:x1876180533886720:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 166us (11090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265609.344784:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:2.0:1789265609.344822:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:2.0:1789265609.344829:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2342:x1876180533886336:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265609.344854:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2342:x1876180533886336:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 27us (10175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265609.344860:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00010000:00010000:1.0:1789265609.374996:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265610.015454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.016066:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533887104 00000100:00100000:2.0:1789265610.016080:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533887104 00000100:00100000:2.0:1789265610.016149:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:2.0:1789265610.016159:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+6:14395:x1876180533887104:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265610.016181:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265610.016209:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f600/0x8e12577ef8190895 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8895 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.016287:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.016303:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.016318:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.016382:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.016391:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.016398:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.017927:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fe00/0x8e12577ef81908aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.017947:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fe00/0x8e12577ef81908aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.017959:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fe00/0x8e12577ef81908aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265610.020420:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265610.020425:0:14307:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265610.020496:0:14307:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fe00/0x8e12577ef81908aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020514:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020522:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020530:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020558:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.020562:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020570:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020585:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9254053cb200) 00010000:00010000:2.0:1789265610.020589:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.020594:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020600:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819089c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020620:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020627:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020633:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020638:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677f000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.020641:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020648:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020669:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9254038f8900) 00010000:00010000:2.0:1789265610.020672:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.020675:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020683:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020731:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f600/0x8e12577ef8190895 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8895 expref: 8 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020747:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fe00/0x8e12577ef81908aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8895 expref: 7 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.020757:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9254038f8d00) 00010000:00010000:2.0:1789265610.020759:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265610.020762:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677fe00, rc 0) 00000100:00100000:2.0:1789265610.020870:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+7:14395:x1876180533887104:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 4710us (5435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265610.020880:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1789265610.032284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265610.032700:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533887360 00000100:00100000:1.0:1789265610.032710:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533887360 00000100:00100000:1.0:1789265610.032781:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:1.0:1789265610.032792:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+7:14395:x1876180533887360:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265610.032812:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265610.032834:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925304270a00/0x8e12577ef81908b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f889c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.032921:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.032938:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.032961:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.033053:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.033063:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.033070:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.033973:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925304271a00/0x8e12577ef81908c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.033986:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925304271a00/0x8e12577ef81908c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.033994:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925304271a00/0x8e12577ef81908c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265610.034005:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789265610.034627:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034637:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034644:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034650:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304271800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265610.034655:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034672:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034687:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9254038f8d00) 00010000:00010000:1.0:1789265610.034690:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265610.034694:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034700:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925304271800/0x8e12577ef81908b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034715:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034721:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034727:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034733:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925304271400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:1.0:1789265610.034736:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034742:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034750:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9254053cbd00) 00010000:00010000:1.0:1789265610.034752:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265610.034755:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.034769:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925304271400/0x8e12577ef81908bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.040772:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925304270a00/0x8e12577ef81908b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f889c expref: 10 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.040807:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925304271a00/0x8e12577ef81908c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f889c expref: 9 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.040816:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9254053cb300) 00010000:00010000:1.0:1789265610.040819:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265610.040823:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925304271a00, rc 0) 00000100:00100000:1.0:1789265610.042796:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14395:x1876180533887360:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 9998us (10517us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789265610.042808:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:0.0:1789265610.070758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.071215:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533887488 00000100:00100000:2.0:1789265610.071228:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533887488 00000100:00100000:2.0:1789265610.071296:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1789265610.071306:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14395:x1876180533887488:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789265610.071460:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14395:x1876180533887488:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 Request processed in 154us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265610.071468:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:3.0:1789265610.143251:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265610.143279:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553802240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265610.143411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265610.143807:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553802496:0@lo:400:kworker.0 00000100:00100000:1.0:1789265610.143843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265610.143871:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789265610.143876:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553802368:0@lo:400:kworker.0 00000100:00100000:1.0:1789265610.143903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265610.143921:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553802880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265610.143946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265610.143988:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553802624:0@lo:400:kworker.0 00000100:00100000:1.0:1789265610.144011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265610.144029:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265610.144041:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553802752:0@lo:400:kworker.0 00000100:00100000:1.0:1789265610.144067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265610.144095:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553802880 00000100:00100000:1.0:1789265610.144103:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553802880 00000100:00100000:1.0:1789265610.144148:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553802624 00000100:00100000:1.0:1789265610.144151:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553802624 00000100:00100000:1.0:1789265610.144168:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553802752 00000100:00100000:1.0:1789265610.144170:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553802752 00000100:00100000:1.0:1789265610.144185:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265610.144683:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553803008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265610.144715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265610.144750:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265610.144760:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553802624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265610.144816:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876180553802624:12345-0@lo:400:kworker.0 Request processed in 58us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265610.144823:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265610.144868:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265610.144875:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553802752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265610.144905:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876180553802752:12345-0@lo:400:kworker.0 Request processed in 32us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265610.144912:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265610.144958:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876180553802752:0@lo:400:kworker.0 00000100:00100000:2.0:1789265610.144969:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876180553802624:0@lo:400:kworker.0 00000100:00100000:1.0:1789265610.145154:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553802880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265610.145582:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553802240 00000100:00100000:0.0:1789265610.145589:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553802240 00000100:00100000:0.0:1789265610.145620:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553803008 00000100:00100000:0.0:1789265610.145623:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553803008 00000100:00100000:0.0:1789265610.145639:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265610.145671:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553802240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265610.145705:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265610.145752:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553802240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265610.145758:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265610.145773:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265610.145779:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553803008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265610.145798:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265610.145825:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553803008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265610.145830:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265610.145863:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553802368 00000100:00100000:0.0:1789265610.145867:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553802368 00000100:00100000:0.0:1789265610.145894:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789265610.145900:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925304278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3305:x1876180553802368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265610.145931:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925304278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3305:x1876180553802368:12345-0@lo:400:kworker.0 Request processed in 31us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265610.145936:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1789265610.145986:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265610.145990:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265610.145993:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265610.146005:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553802496 00000100:00100000:0.0:1789265610.146009:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553802496 00000100:00100000:0.0:1789265610.146036:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265610.146042:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553802496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265610.146072:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876180553802496:12345-0@lo:400:kworker.0 Request processed in 31us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265610.146088:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265610.146137:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553802240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265610.146770:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92544185fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876180553802880:12345-0@lo:400:kworker.0 Request processed in 2574us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265610.146779:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265610.146944:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876180553802880:0@lo:400:kworker.0 00000100:00100000:2.0:1789265610.146958:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553802496:0@lo:400:kworker.0 00000100:00100000:2.0:1789265610.146995:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876180553803008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265610.147006:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3305:1876180553802368:0@lo:400:kworker.0 00000100:00100000:0.0:1789265610.148679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.151600:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533887616 00000100:00100000:2.0:1789265610.151618:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533887616 00000100:00100000:2.0:1789265610.151679:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:2.0:1789265610.151689:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14401:x1876180533887616:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265610.151709:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265610.151746:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f600/0x8e12577ef81908d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88a3 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.151820:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.151839:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.151851:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.151867:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.151874:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.151879:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152134:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152144:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152150:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152157:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677f000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.152162:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152178:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152203:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9254053cb200) 00010000:00010000:2.0:1789265610.152207:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.152213:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152219:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81908db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152235:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152241:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152247:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152251:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.152254:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152260:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152268:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9254038f8900) 00010000:00010000:2.0:1789265610.152271:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.152274:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152290:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef81908e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152405:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f600/0x8e12577ef81908d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88a3 expref: 10 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152418:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9254053cb200) 00010000:00010000:2.0:1789265610.152421:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.152425:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f600/0x8e12577ef81908d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88a3 expref: 10 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.152446:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677f600, rc 0) 00000100:00100000:2.0:1789265610.152526:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14401:x1876180533887616:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 837us (3853us total) trans 0 rc 301/301 00000100:00100000:2.0:1789265610.152534:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:0.0:1789265610.159717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.159825:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533887744 00000100:00100000:2.0:1789265610.159837:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533887744 00000100:00100000:2.0:1789265610.159901:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:2.0:1789265610.159913:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14401:x1876180533887744:12345-192.168.204.43@tcp:700:lfs.0 00000100:00100000:2.0:1789265610.160017:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14401:x1876180533887744:12345-192.168.204.43@tcp:700:lfs.0 Request processed in 106us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265610.160026:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1789265610.162915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265610.164828:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533888000 00000100:00100000:0.0:1789265610.164844:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533888000 00000100:00100000:0.0:1789265610.164928:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:0.0:1789265610.164940:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14401:x1876180533888000:12345-192.168.204.43@tcp:36:lfs.0 00010000:00010000:0.0:1789265610.165023:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265610.165051:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925304270600/0x8e12577ef8190817 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f881e expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.165078:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9254053cb200) 00010000:00010000:0.0:1789265610.165083:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265610.165614:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.165630:0:14307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 5 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.165640:0:14307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.166513:0:14307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 5 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.166535:0:14307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 5 pid: 14306 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265610.166566:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437501c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14307:1876180553803136:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265610.166694:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff9253050e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265610.171549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265610.171724:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437501c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14307:1876180553803136:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265610.171782:0:14307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265610.171793:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533888128 00000100:00100000:2.0:1789265610.171808:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533888128 00010000:00010000:2.0:1789265610.171854:0:14292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 6 pid: 14306 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265610.171925:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:2.0:1789265610.171936:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2342:x1876180533888128:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265610.171953:0:14292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265610.171962:0:14292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 6 pid: 14306 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.171977:0:14292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 6 pid: 14306 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.171998:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef819084f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8880 expref: 6 pid: 14306 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.172016:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9254053cb200) 00010000:00010000:2.0:1789265610.172021:0:14292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.172030:0:14292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.172037:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.172066:0:14292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265610.172128:0:14307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265610.172137:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2342:x1876180533888128:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 201us (599us total) trans 0 rc 0/0 00010000:00010000:3.0:1789265610.172165:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265610.172171:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00010000:00010000:3.0:1789265610.172217:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.172233:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.172245:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265610.176470:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789265610.176495:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.176507:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.176515:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.176520:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265610.176595:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.176605:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.176627:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9254053cb200) 00010000:00010000:3.0:1789265610.176631:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265610.176636:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.176643:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995000/0x8e12577ef81908e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265610.176666:0:14307:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000826fd309 reply state 00000000c61cd9ba transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265610.176674:0:14307:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265610.176892:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+10:14401:x1876180533888000:12345-192.168.204.43@tcp:36:lfs.0 Request processed in 11940us (13977us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789265610.176902:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00010000:00010000:3.0:1789265610.186042:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.186068:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.186077:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.186084:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884200 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265610.186090:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.186117:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.186139:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff925409ab9600) 00010000:00010000:3.0:1789265610.186144:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265610.186150:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.186158:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265610.275201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265610.275935:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533888256 00000100:00100000:3.0:1789265610.275951:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533888256 00000100:00100000:3.0:1789265610.276036:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:3.0:1789265610.276048:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+9:14409:x1876180533888256:12345-192.168.204.43@tcp:101:lctl.0 00010000:00010000:3.0:1789265610.276080:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265610.276110:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88aa expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.276204:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81908fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.276223:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81908fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.276237:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81908fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265610.276284:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265610.276306:0:14308:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265610.276418:0:14308:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81908fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.276461:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81908f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88aa expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.276483:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884a00/0x8e12577ef81908fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88aa expref: 10 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.276492:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:3.0:1789265610.276495:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265610.276500:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884a00, rc 0) 00000100:00100000:3.0:1789265610.277091:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+10:14409:x1876180533888256:12345-192.168.204.43@tcp:101:lctl.0 Request processed in 1039us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265610.277101:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:0.0:1789265610.301007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265610.301101:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533888384 00000100:00100000:1.0:1789265610.301119:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533888384 00000100:00100000:1.0:1789265610.301211:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:1.0:1789265610.301226:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:14410:x1876180533888384:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1789265610.301256:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265610.301288:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925304270c00/0x8e12577ef8190905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88b1 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.301569:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925304270400/0x8e12577ef819090c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.301591:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925304270400/0x8e12577ef819090c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.301606:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925304270400/0x8e12577ef819090c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265610.301673:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265610.301677:0:14306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265610.301853:0:14306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925304270400/0x8e12577ef819090c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.301959:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925304270c00/0x8e12577ef8190905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88b1 expref: 7 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.301984:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925304270400/0x8e12577ef819090c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88b1 expref: 6 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.301995:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:1.0:1789265610.301998:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265610.302003:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925304270400, rc 0) 00000100:00100000:1.0:1789265610.302236:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:14410:x1876180533888384:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1013us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265610.302245:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:1.0:1789265610.307300:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.308795:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533888512 00000100:00100000:2.0:1789265610.308832:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533888512 00000100:00100000:2.0:1789265610.309047:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:2.0:1789265610.309060:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:14410:x1876180533888512:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265610.309089:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265610.309118:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88b8 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.309202:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.309221:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.309235:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.309251:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.309258:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.309264:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312353:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190928 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312383:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312406:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265610.312736:0:16188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265610.312741:0:16188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265610.312765:0:16188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312782:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312788:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312795:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312801:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677f000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.312806:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312813:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312827:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:2.0:1789265610.312831:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.312835:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312842:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef819091a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312859:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312881:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312887:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312892:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677e800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.312895:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312900:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312908:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9254038f8900) 00010000:00010000:2.0:1789265610.312910:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.312913:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312919:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190921 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312964:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88b8 expref: 8 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312982:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190928 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88b8 expref: 7 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.312991:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9254038f8100) 00010000:00010000:2.0:1789265610.312993:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265610.313002:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677e400, rc 0) 00000100:00100000:2.0:1789265610.313097:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+7:14410:x1876180533888512:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 4038us (5811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265610.313107:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:2.0:1789265610.320663:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265610.325764:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533888768 00000100:00100000:3.0:1789265610.325793:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533888768 00000100:00100000:2.0:1789265610.325995:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:2.0:1789265610.326011:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+7:14410:x1876180533888768:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265610.326045:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265610.326099:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef819092f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88bf expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265610.326264:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265610.327115:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef819092f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88bf expref: 9 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.327137:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:2.0:1789265610.327141:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265610.327148:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef819092f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88bf expref: 9 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.327166:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677fa00, rc 0) 00000100:00100000:2.0:1789265610.327273:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+8:14410:x1876180533888768:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1265us (6625us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789265610.327281:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:3.0:1789265610.332216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.332295:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533889024 00000100:00100000:2.0:1789265610.332318:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533889024 00000100:00100000:2.0:1789265610.332611:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:2.0:1789265610.332624:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+8:14410:x1876180533889024:12345-192.168.204.43@tcp:36:lfs.0 00010000:00010000:2.0:1789265610.332744:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265610.332787:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190928 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88b8 expref: 8 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.332815:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9254038f8100) 00010000:00010000:2.0:1789265610.332829:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265610.332861:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.332877:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.332890:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265610.333177:0:14308:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bd12f35 reply state 00000000e7633185 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265610.333190:0:14308:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789265610.333201:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789265610.335092:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+9:14410:x1876180533889024:12345-192.168.204.43@tcp:36:lfs.0 Request processed in 2450us (2870us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789265610.335110:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00010000:00010000:2.0:1789265610.344658:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.344687:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.344697:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.344721:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677fc00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.344727:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.344735:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.344758:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9254038f8900) 00010000:00010000:2.0:1789265610.344762:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789265610.344768:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.344774:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef819093d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265610.345053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.345732:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533889280 00000100:00100000:2.0:1789265610.345749:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533889280 00000100:00100000:2.0:1789265610.345967:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:2.0:1789265610.345982:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+8:14410:x1876180533889280:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:2.0:1789265610.346547:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+9:14410:x1876180533889280:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 564us (1500us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789265610.346557:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:0.0:1789265610.355125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.355550:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533889536 00000100:00100000:2.0:1789265610.355561:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533889536 00000100:00100000:2.0:1789265610.355713:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:2.0:1789265610.355724:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+9:14410:x1876180533889536:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265610.355748:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265610.355786:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88c6 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.355873:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.356080:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.356097:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.356114:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.356121:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.356127:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265610.357140:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265610.357541:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357553:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357560:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357567:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677e400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.357571:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357592:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357607:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:2.0:1789265610.357671:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.357678:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357685:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef819094b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357703:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357709:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357714:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357719:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677fa00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265610.357721:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357727:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357734:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9254038f8900) 00010000:00010000:2.0:1789265610.357736:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265610.357739:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357754:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190952 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357806:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190944 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88c6 expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357818:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:2.0:1789265610.357820:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265610.357824:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88c6 expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.357834:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677fc00, rc 0) 00000100:00100000:2.0:1789265610.358048:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+10:14410:x1876180533889536:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 2324us (2931us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789265610.358057:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:0.0:1789265610.364825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265610.364893:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533889664 00000100:00100000:3.0:1789265610.364906:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533889664 00000100:00100000:3.0:1789265610.364966:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:3.0:1789265610.364984:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+10:14410:x1876180533889664:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265610.365012:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265610.365043:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190960 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88cd expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.365149:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.365186:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.365200:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265610.365229:0:16188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265610.365233:0:16188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265610.365255:0:16188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.365289:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef8190960 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 12 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.365311:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 11 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.365321:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff925409ab9a00) 00010000:00010000:3.0:1789265610.365325:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265610.365328:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:3.0:1789265610.365492:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+11:14410:x1876180533889664:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 516us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265610.365501:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:0.0:1789265610.371975:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.372037:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533889792 00000100:00100000:2.0:1789265610.372051:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533889792 00000100:00100000:2.0:1789265610.372117:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:2.0:1789265610.372129:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+11:14410:x1876180533889792:12345-192.168.204.43@tcp:37:lfs.0 00000100:00100000:0.0:1789265610.378714:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+11:14410:x1876180533889792:12345-192.168.204.43@tcp:37:lfs.0 Request processed in 6573us (6741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265610.378731:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:0.0:1789265610.384046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265610.384137:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533890048 00000100:00100000:3.0:1789265610.384149:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533890048 00000100:00100000:3.0:1789265610.384215:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:3.0:1789265610.384228:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+11:14410:x1876180533890048:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265610.384987:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+12:14410:x1876180533890048:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 757us (950us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789265610.385010:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00010000:00010000:1.0:1789265610.398785:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265610.460870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265610.460973:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533890176 00000100:00100000:3.0:1789265610.460986:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533890176 00000100:00100000:3.0:1789265610.461057:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:3.0:1789265610.461069:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+10:14416:x1876180533890176:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265610.461095:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265610.461119:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef819096e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88d4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461191:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461206:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461218:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461232:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461239:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461245:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461538:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884c00/0x8e12577ef8190983 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461562:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884c00/0x8e12577ef8190983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.461570:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884c00/0x8e12577ef8190983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265610.461601:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265610.461605:0:14306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265610.462166:0:14306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884c00/0x8e12577ef8190983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462183:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462189:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462196:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462203:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265610.462208:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462216:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462230:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:3.0:1789265610.462233:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265610.462238:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462258:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462276:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462282:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462288:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462294:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265610.462298:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462304:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462835:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff925409ab9b00) 00010000:00010000:3.0:1789265610.462838:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265610.462842:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462848:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef819097c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462889:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef819096e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88d4 expref: 12 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462917:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884c00/0x8e12577ef8190983 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88d4 expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.462925:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff925409ab9a00) 00010000:00010000:3.0:1789265610.462927:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789265610.462930:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884c00, rc 0) 00000100:00100000:2.0:1789265610.463161:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+11:14416:x1876180533890176:12345-192.168.204.43@tcp:101:bash.0 Request processed in 2091us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265610.463172:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:2.0:1789265610.467133:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265610.467258:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533890432 00000100:00100000:0.0:1789265610.467270:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533890432 00000100:00100000:0.0:1789265610.467763:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:0.0:1789265610.467776:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+11:14416:x1876180533890432:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265610.467801:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265610.467826:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef819098a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88db expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.468036:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.468052:0:14308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 11 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.468082:0:14308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.468118:0:14308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 11 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.468133:0:14308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 11 pid: 16188 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265610.468149:0:14308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14308:1876180553803264:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265610.468262:0:14308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9253050e9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265610.471245:0:14308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14308:1876180553803264:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265610.471275:0:14308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265610.473597:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265610.474109:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533890560 00000100:00100000:3.0:1789265610.474121:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533890560 00010000:00010000:3.0:1789265610.474166:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 12 pid: 16188 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265610.474214:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:3.0:1789265610.474225:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+12:2342:x1876180533890560:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265610.474240:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265610.474246:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 12 pid: 16188 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.474259:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 12 pid: 16188 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.474282:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190967 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88cd expref: 12 pid: 16188 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.474323:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff925409ab9a00) 00010000:00010000:3.0:1789265610.474329:0:14291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.474401:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.474410:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.474448:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265610.474510:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+11:2342:x1876180533890560:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 285us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265610.474517:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00010000:00010000:0.0:1789265610.474879:0:14308:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.474899:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.474927:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.474938:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.474947:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478168:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478204:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478216:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265610.478230:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789265610.478261:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478268:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478275:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478281:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265610.478285:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478292:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478305:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff925409ab9a00) 00010000:00010000:0.0:1789265610.478319:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265610.478323:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478889:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190991 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265610.478911:0:14308:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6b51408 reply state 00000000bb12fc72 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265610.478930:0:14308:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789265610.478969:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef819098a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 14 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478985:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 13 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.478992:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:0.0:1789265610.478994:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789265610.478997:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995600, rc 0) 00000100:00100000:0.0:1789265610.479085:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+14:14416:x1876180533890432:12345-192.168.204.43@tcp:101:bash.0 Request processed in 11311us (11962us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789265610.479094:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00010000:00010000:3.0:1789265610.482680:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.482765:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.482772:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.482779:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265610.482785:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.482792:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.482830:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92542b074700) 00010000:00010000:3.0:1789265610.482834:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265610.482838:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.482844:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994600/0x8e12577ef8190998 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265610.497776:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.497968:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533890688 00000100:00100000:2.0:1789265610.497979:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533890688 00000100:00100000:2.0:1789265610.498109:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:2.0:1789265610.498120:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+13:14416:x1876180533890688:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265610.498147:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265610.498170:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef81909ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88e2 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.498241:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef81909b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.498256:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef81909b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.498267:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef81909b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265610.498311:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789265610.498315:0:14307:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265610.498518:0:14307:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef81909b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.498531:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef81909b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.498558:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef81909ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88e2 expref: 15 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.498579:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef81909b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88e2 expref: 14 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.498587:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:2.0:1789265610.498597:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265610.498601:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677e800, rc 0) 00000100:00100000:2.0:1789265610.498741:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+14:14416:x1876180533890688:12345-192.168.204.43@tcp:101:bash.0 Request processed in 622us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265610.498749:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:2.0:1789265610.504201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265610.504290:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533890944 00000100:00100000:0.0:1789265610.504300:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533890944 00000100:00100000:0.0:1789265610.504400:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:0.0:1789265610.504411:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+14:14416:x1876180533890944:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:0.0:1789265610.504802:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+15:14416:x1876180533890944:12345-192.168.204.43@tcp:35:bash.0 Request processed in 392us (613us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789265610.504810:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:2.0:1789265610.700673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265610.701571:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533891200 00000100:00100000:3.0:1789265610.701587:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533891200 00000100:00100000:3.0:1789265610.701742:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:3.0:1789265610.701755:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+15:14426:x1876180533891200:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1789265610.701786:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265610.701808:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81909bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88e9 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265610.701903:0:16188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789265610.702035:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81909bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88e9 expref: 17 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.702051:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:3.0:1789265610.702054:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265610.702060:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81909bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88e9 expref: 17 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265610.702077:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884e00, rc 0) 00000100:00100000:3.0:1789265610.703785:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+16:14426:x1876180533891200:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1925us (3019us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789265610.703814:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:1.0:1789265610.714888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265610.716317:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533891456 00000100:00100000:0.0:1789265610.716385:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533891456 00000100:00100000:0.0:1789265610.716470:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:0.0:1789265610.716481:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+16:14426:x1876180533891456:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265610.717531:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+17:14426:x1876180533891456:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 1043us (2645us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789265610.717559:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000040:00080000:1.0:1789265610.720950:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265610.803753:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265610.803888:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533891712 00000100:00100000:2.0:1789265610.803899:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533891712 00000100:00100000:2.0:1789265610.803971:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:2.0:1789265610.803982:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+17:14429:x1876180533891712:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1789265610.804007:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265610.804029:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81909c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88f0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.804148:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f400/0x8e12577ef81909d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.804164:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f400/0x8e12577ef81909d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.804179:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f400/0x8e12577ef81909d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265610.804191:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265610.804379:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f000/0x8e12577ef81909c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88f0 expref: 20 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.804399:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f400/0x8e12577ef81909d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88f0 expref: 19 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265610.804433:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:2.0:1789265610.804436:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265610.804439:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677f400, rc 0) 00000100:00100000:2.0:1789265610.804502:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+19:14429:x1876180533891712:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 522us (764us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789265610.804509:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:2.0:1789265610.809661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265610.809806:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533891968 00000100:00100000:1.0:1789265610.809819:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533891968 00000100:00100000:1.0:1789265610.809909:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:1.0:1789265610.809934:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+19:2343:x1876180533891968:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265610.809951:0:14292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265610.809975:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f400/0x8e12577ef81909d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88f0 expref: 19 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265610.809995:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:1.0:1789265610.810000:0:14292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265610.810059:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+18:2343:x1876180533891968:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 127us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265610.810066:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:1.0:1789265610.813947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265610.814163:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533891840 00000100:00100000:0.0:1789265610.814174:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533891840 00000100:00100000:0.0:1789265610.814239:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:0.0:1789265610.814250:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+18:14429:x1876180533891840:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:0.0:1789265610.814390:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814408:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814432:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814460:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814467:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814474:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814481:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265610.814487:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814495:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814507:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:0.0:1789265610.814525:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265610.814529:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265610.814535:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef81909de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265610.814618:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+18:14429:x1876180533891840:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 370us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265610.814626:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:2.0:1789265610.818962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265610.819109:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533892224 00000100:00100000:0.0:1789265610.819122:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533892224 00000100:00100000:0.0:1789265610.819195:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:0.0:1789265610.819208:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+18:14429:x1876180533892224:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265610.819527:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+19:14429:x1876180533892224:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 321us (575us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789265610.819535:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:3.0:1789265611.208536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265611.208584:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533892480 00000100:00100000:3.0:1789265611.208597:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533892480 00000100:00080000:3.0:1789265611.208625:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265611.208680:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:3.0:1789265611.208692:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+19:14460:x1876180533892480:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:3.0:1789265611.208723:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265611.208748:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81909e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88f7 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.208868:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81909ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.208884:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81909ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.208896:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81909ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265611.208908:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789265611.209114:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef81909e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88f7 expref: 22 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.209135:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81909ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88f7 expref: 21 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.209145:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:3.0:1789265611.209160:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265611.209165:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884200, rc 0) 00000100:00100000:3.0:1789265611.209229:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+21:14460:x1876180533892480:12345-192.168.204.43@tcp:101:cat.0 Request processed in 539us (704us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789265611.209236:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:3.0:1789265611.216649:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265611.220441:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533892736 00000100:00100000:0.0:1789265611.220457:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533892736 00000100:00100000:0.0:1789265611.220541:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1789265611.220553:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+21:14460:x1876180533892736:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:0.0:1789265611.220958:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+22:14460:x1876180533892736:12345-192.168.204.43@tcp:35:cat.0 Request processed in 406us (4319us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789265611.220967:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:2.0:1789265611.227665:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265611.227801:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533892864 00000100:00100000:1.0:1789265611.227813:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533892864 00000100:00100000:1.0:1789265611.227901:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:1.0:1789265611.227912:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+22:2343:x1876180533892864:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265611.231188:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265611.231228:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884200/0x8e12577ef81909ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88f7 expref: 22 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265611.231255:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:1.0:1789265611.231261:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265611.231393:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+21:2343:x1876180533892864:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 3482us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265611.231403:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00000001:00080000:2.0:1789265611.259894:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:2.0:1789265611.259931:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1789265611.260136:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789265611.323935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265611.325182:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533893120 00000100:00100000:0.0:1789265611.325197:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533893120 00000100:00100000:0.0:1789265611.325288:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:0.0:1789265611.325302:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+13:14466:x1876180533893120:12345-192.168.204.43@tcp:101:dd.0 00010000:00010000:2.0:1789265611.326135:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265611.326164:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e000/0x8e12577ef81909fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f88fe expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.326277:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.326293:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.326306:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265611.326317:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265611.326548:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e000/0x8e12577ef81909fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.326584:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 15 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.327404:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:2.0:1789265611.327409:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265611.327424:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677ee00, rc 0) 00000100:00100000:2.0:1789265611.327807:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+15:14466:x1876180533893120:12345-192.168.204.43@tcp:101:dd.0 Request processed in 2504us (3879us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789265611.327817:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:2.0:1789265611.339472:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265611.339746:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265611.339918:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533893504 00000100:00100000:3.0:1789265611.339931:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533893504 00000100:00100000:3.0:1789265611.340012:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:3.0:1789265611.340025:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+15:14466:x1876180533893504:12345-192.168.204.43@tcp:36:dd.0 00010000:00010000:3.0:1789265611.340105:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265611.340376:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef81909b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88e2 expref: 15 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.340398:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:3.0:1789265611.340403:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265611.340652:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.340669:0:14307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 15 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.340679:0:14307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.340713:0:14307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 15 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.340729:0:14307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 15 pid: 14308 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265611.340762:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14307:1876180553803392:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265611.340871:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265611.342508:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533893248 00000100:00100000:1.0:1789265611.342522:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533893248 00010000:00010000:1.0:1789265611.342584:0:14292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 16 pid: 14308 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265611.342810:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:1.0:1789265611.342821:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441347450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+16:2345:x1876180533893248:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265611.342836:0:14292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265611.342842:0:14292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 16 pid: 14308 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265611.342854:0:14292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 16 pid: 14308 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265611.343509:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:1.0:1789265611.343517:0:14292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265611.343528:0:14292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265611.343536:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265611.343557:0:14292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265611.343959:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441347450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+16:2345:x1876180533893248:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1136us (4496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265611.343972:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00010000:00010000:0.0:1789265611.344449:0:14307:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.43@tcp) returned -22 from blocking AST (req@00000000788a3e7a x1876180553803392) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 15 pid: 14308 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.344464:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677ee00/0x8e12577ef8190a01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88fe expref: 15 pid: 14308 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265611.344482:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14307:1876180553803392:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265611.344503:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:0.0:1789265611.344509:0:14307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.344518:0:14307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.344523:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265611.344648:0:14307:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789265611.344726:0:14307:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4cfe488 reply state 00000000f16fb30f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265611.344735:0:14307:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265611.344847:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+16:14466:x1876180533893504:12345-192.168.204.43@tcp:36:dd.0 Request processed in 4824us (5101us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789265611.344855:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000020:00080000:0.0:1789265611.344859:0:14307:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265611.356721:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.356743:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.356752:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.356759:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:2.0:1789265611.356765:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.356773:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.356798:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:2.0:1789265611.356831:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265611.356839:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.356849:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884e00/0x8e12577ef8190a0f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.423024:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265611.485559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265611.486074:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533893760 00000100:00100000:3.0:1789265611.486086:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533893760 00000100:00100000:3.0:1789265611.486160:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:3.0:1789265611.486172:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+15:14466:x1876180533893760:12345-192.168.204.43@tcp:35:dd.0 00000100:00100000:3.0:1789265611.486517:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+16:14466:x1876180533893760:12345-192.168.204.43@tcp:35:dd.0 Request processed in 346us (966us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1789265611.486526:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:3.0:1789265611.767012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265611.769765:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533893888 00000100:00100000:2.0:1789265611.769786:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533893888 00000100:00100000:2.0:1789265611.769886:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:2.0:1789265611.769898:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+16:14480:x1876180533893888:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:2.0:1789265611.769927:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265611.769951:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f800/0x8e12577ef8190a16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8905 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.770024:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.770040:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.770054:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.770068:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.770075:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.770081:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.771174:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190a2b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.771191:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190a2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265611.771201:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190a2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265611.771249:0:16188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789265611.771254:0:16188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265611.788326:0:16188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190a2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788394:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190a2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788416:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788424:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788431:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788437:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677e400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265611.788441:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788449:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788465:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff925409ab9a00) 00010000:00010000:0.0:1789265611.788468:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265611.788473:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788479:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e400/0x8e12577ef8190a1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788499:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788505:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788517:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788522:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92530677fa00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265611.788525:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788531:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788540:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9254038f8900) 00010000:00010000:0.0:1789265611.788543:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265611.788546:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788552:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fa00/0x8e12577ef8190a24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788608:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677f800/0x8e12577ef8190a16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8905 expref: 18 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788624:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190a2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8905 expref: 17 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265611.788647:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:0.0:1789265611.788649:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265611.788652:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677fc00, rc 0) 00000100:00100000:0.0:1789265611.788739:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+17:14480:x1876180533893888:12345-192.168.204.43@tcp:101:stat.0 Request processed in 18841us (21735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265611.788757:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:2.0:1789265611.843200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265611.846113:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533894144 00000100:00100000:3.0:1789265611.846133:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533894144 00000100:00100000:3.0:1789265611.846221:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:3.0:1789265611.846232:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+17:14486:x1876180533894144:12345-192.168.204.43@tcp:36:truncate.0 00010000:00010000:3.0:1789265611.846313:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265611.846619:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677fc00/0x8e12577ef8190a2b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8905 expref: 17 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.846644:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:3.0:1789265611.846649:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265611.846874:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.846888:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.846917:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265611.846976:0:14306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1789265611.847003:0:14306:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4f83192 reply state 00000000d0765db9 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265611.847013:0:14306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265611.847203:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+19:14486:x1876180533894144:12345-192.168.204.43@tcp:36:truncate.0 Request processed in 970us (4010us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789265611.847210:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00000020:00080000:3.0:1789265611.847216:0:14306:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265611.853216:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.853236:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.853243:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.853248:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265611.853253:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.853272:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.853293:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:3.0:1789265611.853297:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265611.853356:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265611.853365:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a32 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265612.065906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.066031:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533894272 00000100:00100000:0.0:1789265612.066040:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533894272 00000100:00100000:0.0:1789265612.066089:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:0.0:1789265612.066097:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+18:14500:x1876180533894272:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:0.0:1789265612.066121:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265612.066145:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef8190a39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f890c expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066216:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066231:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066243:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066258:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066263:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066267:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066710:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066809:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066818:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265612.066862:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1789265612.066867:0:14308:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265612.066885:0:14308:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066897:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066905:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066912:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066919:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066925:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265612.066929:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066936:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066948:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff925409ab9a00) 00010000:00010000:0.0:1789265612.066957:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265612.066963:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066969:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190a40 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066985:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066991:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.066996:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.067002:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265612.067005:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.067010:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.067018:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92542b074b00) 00010000:00010000:0.0:1789265612.067020:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265612.067023:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.067030:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.067064:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef8190a39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 20 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.067089:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.067097:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:0.0:1789265612.067100:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265612.067102:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995c00, rc 0) 00000100:00100000:0.0:1789265612.067176:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+19:14500:x1876180533894272:12345-192.168.204.43@tcp:101:stat.0 Request processed in 1078us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265612.067184:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:2.0:1789265612.138138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.139608:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533894528 00000100:00100000:0.0:1789265612.139624:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533894528 00000100:00100000:0.0:1789265612.139983:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1789265612.139998:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+19:14510:x1876180533894528:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265612.140027:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265612.140054:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef8190a55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8913 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265612.140174:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789265612.143268:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef8190a55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8913 expref: 21 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.143291:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:0.0:1789265612.143294:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265612.143298:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef8190a55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8913 expref: 21 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.143368:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994c00, rc 0) 00000100:00100000:0.0:1789265612.143478:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+20:14510:x1876180533894528:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 3483us (5361us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1789265612.143486:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:2.0:1789265612.154216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.154375:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533894784 00000100:00100000:3.0:1789265612.154387:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533894784 00000100:00100000:3.0:1789265612.154458:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:3.0:1789265612.154469:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925404e49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+20:14510:x1876180533894784:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1789265612.154761:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925404e49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+21:14510:x1876180533894784:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 292us (554us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789265612.154769:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:2.0:1789265612.239014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.240439:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533895040 00000100:00100000:3.0:1789265612.240457:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533895040 00000100:00100000:3.0:1789265612.240607:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:3.0:1789265612.240619:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+21:14516:x1876180533895040:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265612.240647:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265612.240672:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a63 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f891a expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.240804:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.240821:0:16188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 22 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.240830:0:16188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 22 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.240859:0:16188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.240896:0:16188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 22 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.240917:0:16188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 22 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.240931:0:16188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16188:1876180553803520:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265612.241060:0:16188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 22 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.241071:0:16188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 22 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.241081:0:16188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16188:1876180553803648:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265612.241104:0:16188:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265612.249125:0:16188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16188:1876180553803520:192.168.204.43@tcp:104: 00000100:00100000:3.0:1789265612.249142:0:16188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16188:1876180553803648:192.168.204.43@tcp:104: 00010000:00010000:3.0:1789265612.249173:0:16188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265612.251458:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.251507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265612.251677:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533895168 00000100:00100000:1.0:1789265612.251688:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533895168 00010000:00010000:1.0:1789265612.251736:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 23 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265612.251799:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533895296 00000100:00100000:1.0:1789265612.251803:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533895296 00010000:00010000:1.0:1789265612.251819:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 24 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265612.251849:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:1.0:1789265612.251859:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+24:2342:x1876180533895168:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265612.251875:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265612.251882:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 24 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.251897:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 24 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.251921:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190a4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f890c expref: 24 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.251941:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:1.0:1789265612.251947:0:14291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.251957:0:14291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.251964:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265612.252026:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+23:2342:x1876180533895168:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 168us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265612.252033:0:16425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:3.0:1789265612.252048:0:16425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+23:2343:x1876180533895296:12345-192.168.204.43@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789265612.252049:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00010000:00010000:3.0:1789265612.252068:0:16425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265612.252075:0:16425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 23 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252088:0:16425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 22 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252104:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995600/0x8e12577ef819099f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f88db expref: 22 pid: 14308 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252116:0:16425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:3.0:1789265612.252120:0:16425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252129:0:16425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252137:0:16425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252164:0:16425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265612.252189:0:16425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+21:2343:x1876180533895296:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 146us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265612.252197:0:16425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00010000:00010000:3.0:1789265612.252227:0:16188:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252235:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265612.252266:0:16188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1789265612.252504:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a63 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 22 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252521:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 21 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.252529:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:3.0:1789265612.252532:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265612.252534:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441884400, rc 0) 00000100:00100000:3.0:1789265612.252563:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+21:14516:x1876180533895040:12345-192.168.204.43@tcp:101:bash.0 Request processed in 11947us (13569us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1789265612.252571:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:2.0:1789265612.260760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.260866:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533895552 00000100:00100000:3.0:1789265612.260878:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533895552 00000100:00100000:3.0:1789265612.260950:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:3.0:1789265612.260962:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+21:14516:x1876180533895552:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:3.0:1789265612.261293:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.261313:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.261326:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265612.261447:0:14306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1789265612.261495:0:14306:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000054caac2 reply state 0000000081f354fe transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.261505:0:14306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265612.261615:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14516:x1876180533895552:12345-192.168.204.43@tcp:36:bash.0 Request processed in 655us (866us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1789265612.261623:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00000020:00080000:3.0:1789265612.261629:0:14306:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789265612.264222:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:0.0:1789265612.264384:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.264410:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.264418:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.264425:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265612.264431:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.264439:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.264457:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:0.0:1789265612.264461:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265612.264465:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.264472:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885400/0x8e12577ef8190a78 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.265165:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533895680 00000100:00100000:3.0:1789265612.265178:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533895680 00000100:00100000:3.0:1789265612.265247:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:3.0:1789265612.265258:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14516:x1876180533895680:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265612.265296:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265612.265317:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a7f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8921 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.265427:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a7f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8921 expref: 24 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.265443:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a7f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8921 expref: 24 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.265464:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:3.0:1789265612.265467:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265612.265471:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885000, rc 0) 00000100:00100000:3.0:1789265612.265553:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14516:x1876180533895680:12345-192.168.204.43@tcp:101:bash.0 Request processed in 297us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265612.265561:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:1.0:1789265612.283468:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.283666:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533895808 00000100:00100000:0.0:1789265612.283695:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533895808 00000100:00100000:0.0:1789265612.283774:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1789265612.283786:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14516:x1876180533895808:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1789265612.283811:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265612.283836:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef8190a86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8928 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.283934:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.283951:0:14307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 25 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.283960:0:14307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.284001:0:14307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 25 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.284014:0:14307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 25 pid: 16188 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265612.284028:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14307:1876180553803776:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265612.284124:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080de180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265612.289714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265612.290457:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533895936 00000100:00100000:1.0:1789265612.290473:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533895936 00010000:00010000:1.0:1789265612.290541:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 26 pid: 16188 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265612.290592:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1789265612.290603:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+26:2343:x1876180533895936:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265612.290621:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265612.290628:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 26 pid: 16188 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.290642:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 26 pid: 16188 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265612.290859:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14307:1876180553803776:192.168.204.43@tcp:104: 00010000:00010000:1.0:1789265612.290930:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190a6a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f891a expref: 26 pid: 16188 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.295929:0:14307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.296926:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:1.0:1789265612.296936:0:14291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.296958:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.296967:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.297027:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265612.297121:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+25:2343:x1876180533895936:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 6514us (7415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265612.297131:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00010000:00010000:0.0:1789265612.299081:0:14307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.299115:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265612.299168:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789265612.299173:0:14307:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265612.299197:0:14307:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.299239:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994c00/0x8e12577ef8190a86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8928 expref: 25 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.299262:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8928 expref: 24 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.299272:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:0.0:1789265612.299275:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265612.299279:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994000, rc 0) 00000100:00100000:0.0:1789265612.299696:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14516:x1876180533895808:12345-192.168.204.43@tcp:101:bash.0 Request processed in 15909us (16235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265612.299706:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:2.0:1789265612.312638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265612.321123:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533896192 00000100:00100000:1.0:1789265612.321140:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533896192 00000100:00100000:1.0:1789265612.321302:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:1.0:1789265612.321324:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540c339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14516:x1876180533896192:12345-192.168.204.43@tcp:103:bash.0 00010000:00010000:1.0:1789265612.321365:0:14292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789265612.321400:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190a8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8928 expref: 24 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.321430:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190a7f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8921 expref: 23 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265612.321441:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92542b074600) 00010000:00010000:1.0:1789265612.321451:0:14292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265612.321513:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540c339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+22:14516:x1876180533896192:12345-192.168.204.43@tcp:103:bash.0 Request processed in 192us (8885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265612.321521:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:2.0:1789265612.328528:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.329624:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533896320 00000100:00100000:3.0:1789265612.329636:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533896320 00000100:00100000:3.0:1789265612.329717:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:3.0:1789265612.329728:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+22:14516:x1876180533896320:12345-192.168.204.43@tcp:58:bash.0 00010000:00010000:3.0:1789265612.330093:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.330112:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.330124:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265612.331559:0:14308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265612.331905:0:14308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789265612.332836:0:14308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789265612.333873:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+22:14516:x1876180533896320:12345-192.168.204.43@tcp:58:bash.0 Request processed in 4131us (5341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265612.333887:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:2.0:1789265612.346149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.346537:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533896448 00000100:00100000:3.0:1789265612.346548:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533896448 00000100:00100000:3.0:1789265612.346621:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:3.0:1789265612.346632:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+22:14516:x1876180533896448:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1789265612.346652:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265612.346672:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190a9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f892f expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.346734:0:14306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.346745:0:14306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190a9b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f892f expref: 23 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.346765:0:14306:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.346799:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190a9b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f892f expref: 23 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.346812:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:3.0:1789265612.346815:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265612.346819:0:14306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190a9b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f892f expref: 23 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.346825:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441885c00, rc 0) 00000100:00100000:2.0:1789265612.352428:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14516:x1876180533896448:12345-192.168.204.43@tcp:101:bash.0 Request processed in 5783us (6275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265612.352443:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00010000:00010000:0.0:1789265612.446725:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265612.766675:0:14340:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789265612.766686:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265612.766725:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789265612.766731:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789265612.766870:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14340:1876180553803904:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265612.769060:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254370433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265612.777531:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14340:1876180553803904:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265612.784045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.784961:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533896576 00000100:00100000:2.0:1789265612.784974:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533896576 00000100:00100000:2.0:1789265612.785042:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:2.0:1789265612.785055:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14518:x1876180533896576:12345-192.168.204.43@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789265612.785169:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14518:x1876180533896576:12345-192.168.204.43@tcp:900:lhsmtool_posix.0 Request processed in 117us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265612.785178:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:2.0:1789265612.792443:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.792822:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533896704 00000100:00100000:0.0:1789265612.792844:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533896704 00000100:00100000:0.0:1789265612.792905:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:0.0:1789265612.792917:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14518:x1876180533896704:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265612.792953:0:16188:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265612.793066:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14518:x1876180533896704:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 152us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265612.793091:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:0.0:1789265612.798015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.798404:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533896832 00000100:00100000:3.0:1789265612.798416:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533896832 00000100:00100000:3.0:1789265612.798604:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:3.0:1789265612.798616:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14518:x1876180533896832:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789265612.798705:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798724:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798742:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798818:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798827:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798856:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798886:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798896:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798903:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265612.798945:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789265612.798949:0:14307:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265612.798965:0:14307:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798978:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798987:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798993:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.798999:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265612.799005:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799012:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799030:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9254053cb300) 00010000:00010000:3.0:1789265612.799033:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265612.799038:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799044:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190aa2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799060:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799066:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799072:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799078:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265612.799080:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799086:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799094:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff925409ab9f00) 00010000:00010000:3.0:1789265612.799096:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265612.799099:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799104:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190aa9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799128:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799135:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799141:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799146:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265612.799149:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799169:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799177:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:3.0:1789265612.799179:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265612.799182:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.799189:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ab0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.799283:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14518:x1876180533896832:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 668us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265612.799291:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:2.0:1789265612.815795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.815911:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533897088 00000100:00100000:0.0:1789265612.815924:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533897088 00000100:00100000:0.0:1789265612.815988:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:0.0:1789265612.815998:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14518:x1876180533897088:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265612.816018:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265612.816037:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190ab7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8936 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816141:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816157:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816170:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265612.816182:0:16188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789265612.816301:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816310:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816317:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816322:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265612.816368:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816376:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816399:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:0.0:1789265612.816403:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265612.816408:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816414:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190abe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816474:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190ab7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8936 expref: 25 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816485:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9254053cb300) 00010000:00010000:0.0:1789265612.816487:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265612.816490:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190ab7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8936 expref: 25 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.816500:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995e00, rc 0) 00000100:00100000:0.0:1789265612.816576:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14518:x1876180533897088:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 579us (793us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1789265612.816583:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:1.0:1789265612.821245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.821401:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533897216 00000100:00100000:2.0:1789265612.821412:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533897216 00000100:00100000:2.0:1789265612.821484:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:2.0:1789265612.821496:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543be41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14518:x1876180533897216:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265612.821547:0:14306:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265612.821693:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543be41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14518:x1876180533897216:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 199us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265612.821723:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:1.0:1789265612.832535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.832663:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533897472 00000100:00100000:0.0:1789265612.832674:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533897472 00000100:00100000:0.0:1789265612.832741:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:0.0:1789265612.832753:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14518:x1876180533897472:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265612.832790:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265612.832812:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190acc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f893d expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265612.833741:0:16188:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1789265612.833752:0:16188:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789265612.833806:0:16188:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789265612.834120:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190ad3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.834138:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.834151:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.834216:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190acc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f893d expref: 27 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.834237:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f893d expref: 26 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.834246:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074b00) 00010000:00010000:0.0:1789265612.834249:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265612.834253:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995400, rc 0) 00000100:00100000:0.0:1789265612.834319:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+26:14518:x1876180533897472:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1567us (1793us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789265612.834328:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:0.0:1789265612.845106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.848802:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533897728 00000100:00100000:2.0:1789265612.848820:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533897728 00000100:00100000:3.0:1789265612.849002:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:3.0:1789265612.849016:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+26:14518:x1876180533897728:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265612.849109:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265612.849141:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995400/0x8e12577ef8190ad3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f893d expref: 26 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.849163:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074b00) 00010000:00010000:3.0:1789265612.849176:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265612.849217:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.849233:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.849244:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.849260:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.849279:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.849287:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850029:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850040:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850046:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850059:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441884400 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265612.850064:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850073:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850084:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff925409ab9a00) 00010000:00010000:3.0:1789265612.850087:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265612.850091:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850097:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441884400/0x8e12577ef8190ae1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850108:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850113:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850118:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850123:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885000 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265612.850126:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850132:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850153:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf1c3ee12 (ffff925409ab9f00) 00010000:00010000:3.0:1789265612.850156:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265612.850159:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.850165:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885000/0x8e12577ef8190ae8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf1c3ee12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.852571:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+25:14518:x1876180533897728:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 1248us (5165us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265612.852587:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:1.0:1789265612.852774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.852983:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533897856 00000100:00100000:0.0:1789265612.852994:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533897856 00000100:00100000:0.0:1789265612.853051:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:0.0:1789265612.853060:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+25:14518:x1876180533897856:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265612.853080:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265612.853104:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190aef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8944 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.853139:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190af6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.853166:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.853178:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.853296:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190aef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8944 expref: 27 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.853316:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994000/0x8e12577ef8190af6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8944 expref: 26 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.853325:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:0.0:1789265612.853328:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265612.853365:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994000, rc 0) 00000100:00100000:0.0:1789265612.853444:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+26:14518:x1876180533897856:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 385us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265612.853451:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:1.0:1789265612.857070:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.857189:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533898112 00000100:00100000:0.0:1789265612.857199:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533898112 00000100:00100000:0.0:1789265612.857271:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:0.0:1789265612.857282:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+26:14518:x1876180533898112:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265612.857418:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.857435:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.857448:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265612.861151:0:14307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789265612.861169:0:14307:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 468094836276ns, next at 469094832439ns, rc = 0 00000004:00010000:0.0:1789265612.861277:0:14307:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf8c6bdb reply state 000000003393cde2 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265612.861290:0:14307:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265612.861453:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+28:14518:x1876180533898112:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 4167us (4390us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1789265612.861462:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00010000:00010000:3.0:1789265612.869060:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.869079:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.869087:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.869095:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995c00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:3.0:1789265612.869100:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.869109:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.869127:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:3.0:1789265612.869130:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265612.869153:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.869160:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995c00/0x8e12577ef8190afd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14307 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265612.874639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.874758:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533898240 00000100:00100000:0.0:1789265612.874769:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533898240 00000100:00100000:0.0:1789265612.874841:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:0.0:1789265612.875036:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+27:14518:x1876180533898240:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265612.875063:0:16188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265612.875086:0:16188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f894b expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.875171:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 28 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.875190:0:16188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 28 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.875214:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:0.0:1789265612.875218:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265612.875223:0:16188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995e00, rc 0) 00000100:00100000:0.0:1789265612.875463:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+28:14518:x1876180533898240:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 611us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265612.875470:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:1.0:1789265612.886447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.886519:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533898368 00000100:00100000:0.0:1789265612.886531:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533898368 00000100:00080000:3.0:1789265612.886602:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265612.886622:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:0.0:1789265612.886634:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2343:x1876180533898368:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789265612.888758:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2343:x1876180533898368:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 2118us (2314us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789265612.888772:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:1.0:1789265612.894472:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.894588:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533898624 00000100:00100000:3.0:1789265612.894602:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533898624 00000100:00100000:0.0:1789265612.894698:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1789265612.894712:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+28:14518:x1876180533898624:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265612.895999:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+29:14518:x1876180533898624:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 1268us (1517us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789265612.896012:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:1.0:1789265612.900144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.900390:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533898880 00000100:00100000:3.0:1789265612.900406:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533898880 00000100:00100000:3.0:1789265612.900540:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:3.0:1789265612.900550:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+29:14518:x1876180533898880:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265612.900680:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+29:14518:x1876180533898880:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 131us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265612.900688:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:1.0:1789265612.905570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.905759:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533899008 00000100:00100000:2.0:1789265612.905770:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533899008 00000100:00100000:2.0:1789265612.905987:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:2.0:1789265612.906001:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+29:14518:x1876180533899008:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265612.906027:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265612.906049:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e000/0x8e12577ef8190b0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8952 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.906132:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190b12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.906147:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190b12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.906175:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190b12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265612.906214:0:14308:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265612.906235:0:14308:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190b12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.906274:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e000/0x8e12577ef8190b0b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8952 expref: 31 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.906296:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190b12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8952 expref: 30 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.906323:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:2.0:1789265612.906326:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265612.906414:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677e800, rc 0) 00000100:00100000:2.0:1789265612.906476:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+30:14518:x1876180533899008:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 479us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265612.908639:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:1.0:1789265612.912442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.912680:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533899136 00000100:00100000:0.0:1789265612.912692:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533899136 00000100:00100000:0.0:1789265612.912766:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:0.0:1789265612.912776:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2343:x1876180533899136:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265612.912795:0:14993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265612.912819:0:14993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8959 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265612.913281:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa606cc, blocks: 0x1 00010000:00010000:0.0:1789265612.913304:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1789265612.913329:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265612.913394:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 7 pid: 14993 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.913416:0:14993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 7 pid: 14993 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.913430:0:14993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441995600, rc 0) 00000100:00100000:0.0:1789265612.913494:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+7:2343:x1876180533899136:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 719us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265612.913503:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1789265612.916723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.916765:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533899392 00000100:00100000:0.0:1789265612.916777:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533899392 00000100:00100000:0.0:1789265612.917061:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:0.0:1789265612.917072:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+30:14518:x1876180533899392:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265612.917199:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+30:14518:x1876180533899392:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 128us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265612.917224:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:1.0:1789265612.921130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.921212:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533899520 00000100:00100000:2.0:1789265612.921224:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533899520 00000100:00100000:2.0:1789265612.921291:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:2.0:1789265612.921302:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+30:14518:x1876180533899520:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789265612.945631:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1789265612.945654:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789265612.946165:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+13:14518:x1876180533899520:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 24859us (25040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265612.946177:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:3.0:1789265612.946260:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553804032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789265612.946317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265612.946465:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553804032 00000100:00100000:2.0:1789265612.946472:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553804032 00000100:00100000:2.0:1789265612.946525:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265612.946533:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553804032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789265612.946688:0:15719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789265612.946692:0:15719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789265612.946694:0:15719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789265612.946696:0:15719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789265612 -> 1789265612 00002000:00010000:2.0:1789265612.946699:0:15719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789265612.946739:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876180553804032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (423us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789265612.946759:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1789265612.946798:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92540353c000/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789265612.946804:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553804032:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789265612.946869:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265612.951034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.951149:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533899648 00000100:00100000:0.0:1789265612.951160:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533899648 00000100:00100000:0.0:1789265612.951272:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1789265612.951282:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+7:2342:x1876180533899648:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789265612.951459:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+7:2342:x1876180533899648:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 178us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265612.951468:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1789265612.954543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265612.954671:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533899904 00000100:00100000:3.0:1789265612.954693:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533899904 00000100:00100000:3.0:1789265612.954958:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:3.0:1789265612.954969:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+13:14518:x1876180533899904:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265612.955020:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265612.955047:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92530677e800/0x8e12577ef8190b12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8952 expref: 13 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.955070:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:3.0:1789265612.955091:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265612.955126:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.955139:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.955149:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265612.955439:0:14306:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec732a4f reply state 00000000a070b7a8 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.955450:0:14306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265612.955566:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+14:14518:x1876180533899904:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 597us (1031us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789265612.955573:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00010000:00010000:0.0:1789265612.958591:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.958610:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.958618:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.958625:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885600 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265612.958630:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.958638:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.958656:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:0.0:1789265612.958659:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265612.958664:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.958690:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885600/0x8e12577ef8190b20 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265612.964225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.964511:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533900032 00000100:00100000:2.0:1789265612.964523:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533900032 00000100:00100000:2.0:1789265612.964638:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:2.0:1789265612.964649:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+7:14518:x1876180533900032:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265612.964669:0:15719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265612.964688:0:15719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8960 expref: -99 pid: 15719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.964722:0:15719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 8 pid: 14993 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.964733:0:15719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265612.964737:0:15719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265612.964743:0:15719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 8 pid: 15719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.964778:0:15719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 8 pid: 14993 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.964792:0:15719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 8 pid: 14993 timeout: 568 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265612.964830:0:15719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15719:1876180553804160:192.168.204.43@tcp:104: 00000100:00100000:2.0:1789265612.964915:0:15719:0:(client.c:2715:ptlrpc_set_wait()) set ffff925437043b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265612.973316:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.973465:0:15719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92542b3eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15719:1876180553804160:192.168.204.43@tcp:104: 00010000:00010000:2.0:1789265612.973503:0:15719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 8 pid: 15719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265612.973528:0:15719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677f000, rc 0) 00000100:00100000:2.0:1789265612.973588:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+8:14518:x1876180533900032:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 8941us (9370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265612.973597:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1789265612.973805:0:16425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533900160 00000100:00100000:3.0:1789265612.973812:0:16425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533900160 00010000:00010000:3.0:1789265612.973857:0:16425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 8 pid: 14993 timeout: 568 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.973895:0:16425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:3.0:1789265612.973905:0:16425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+8:2342:x1876180533900160:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265612.973918:0:16425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265612.973942:0:16425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 8 pid: 14993 timeout: 568 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.973956:0:16425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 8 pid: 14993 timeout: 568 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.973993:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d66bdcc5/0x8e12577ef8190b19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8959 expref: 8 pid: 14993 timeout: 568 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.974009:0:16425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265612.974013:0:16425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265612.974020:0:16425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 7 pid: 15719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.974029:0:16425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 7 pid: 15719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265612.974061:0:16425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 7 pid: 15719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265612.974076:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16425:1876180553804288:192.168.204.43@tcp:105: 00000100:00100000:3.0:1789265612.974131:0:16425:0:(client.c:2715:ptlrpc_set_wait()) set ffff925404cf1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265612.980296:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925441a9ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16425:1876180553804288:192.168.204.43@tcp:105: 00010000:00010000:2.0:1789265612.980372:0:16425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265612.980452:0:16425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+7:2342:x1876180533900160:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 6547us (7145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265612.980464:0:16425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1789265612.984066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265612.984220:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533900288 00000100:00100000:2.0:1789265612.984232:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533900288 00000100:00100000:0.0:1789265612.984474:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:0.0:1789265612.984485:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9254377d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+7:2342:x1876180533900288:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789265612.984713:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789265612.984718:0:14993:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789265611 00002000:00010000:0.0:1789265612.984721:0:14993:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789265609 00002000:00010000:0.0:1789265612.984723:0:14993:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789265612 -> 1789265611 00002000:00010000:0.0:1789265612.984725:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789265612.984804:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9254377d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+8:2342:x1876180533900288:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 321us (750us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789265612.984813:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:1.0:1789265612.989912:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.990577:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533900416 00000100:00100000:0.0:1789265612.990590:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533900416 00000100:00100000:0.0:1789265612.990652:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:0.0:1789265612.990664:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+8:2343:x1876180533900416:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789265612.990719:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.990744:0:14991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 8 pid: 15719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.990776:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265612.990781:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265612.990786:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.990843:0:14991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 8 pid: 15719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265612.990860:0:14991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 8 pid: 15719 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265612.990876:0:14991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14991:1876180553804416:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265612.990993:0:14991:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265612.998175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265612.999073:0:14991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14991:1876180553804416:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265612.999105:0:14991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265613.000064:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533900544 00000100:00100000:2.0:1789265613.000077:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533900544 00010000:00010000:2.0:1789265613.000135:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 9 pid: 15719 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265613.000197:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:2.0:1789265613.000208:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+9:2343:x1876180533900544:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265613.000251:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265613.000280:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 9 pid: 15719 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.000294:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 9 pid: 15719 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.001026:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c497cda/0x8e12577ef8190b27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8960 expref: 9 pid: 15719 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.001050:0:14293:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265613.001054:0:14293:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265613.001061:0:14293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.001073:0:14293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.001115:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265613.001644:0:14991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.001657:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.001687:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.001708:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.001716:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.001723:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995a00 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:0.0:1789265613.001727:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.001737:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.001751:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.001759:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712ea949/0x8e12577ef8190b2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265613.002048:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+8:2343:x1876180533900544:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1837us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265613.002058:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:0.0:1789265613.002722:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+7:2343:x1876180533900416:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 11597us (12360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265613.002733:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:3.0:1789265613.006739:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265613.007513:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533900800 00000100:00100000:0.0:1789265613.007524:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533900800 00000100:00100000:0.0:1789265613.007657:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:0.0:1789265613.007688:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+13:14518:x1876180533900800:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789265613.008049:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.008069:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.008082:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.008511:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.008527:0:16188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 14 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.008536:0:16188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.008579:0:16188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 14 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.008595:0:16188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 14 pid: 16188 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265613.008610:0:16188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16188:1876180553804544:192.168.204.43@tcp:104: 00000100:00100000:0.0:1789265613.008712:0:16188:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080de840 going to sleep for 11 seconds 00000100:00080000:3.0:1789265613.008992:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265613.015028:0:16188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16188:1876180553804544:192.168.204.43@tcp:104: 00010000:00010000:0.0:1789265613.015060:0:16188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265613.018686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265613.018797:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533900928 00000100:00100000:1.0:1789265613.018807:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533900928 00010000:00010000:1.0:1789265613.018855:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 15 pid: 16188 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265613.018961:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:1.0:1789265613.018972:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441344c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+15:2343:x1876180533900928:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265613.021397:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265613.021420:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 15 pid: 16188 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.021443:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 15 pid: 16188 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.021469:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995e00/0x8e12577ef8190b04 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f894b expref: 15 pid: 16188 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.021520:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:1.0:1789265613.021526:0:14291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.021534:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.021541:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.021574:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265613.021647:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441344c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+14:2343:x1876180533900928:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 2676us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265613.021656:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00010000:00010000:0.0:1789265613.022749:0:16188:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.022763:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265613.023173:0:16188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1789265613.027100:0:16188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1789265613.027569:0:16188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1789265613.027677:0:16188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16188:1876180553804672:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789265613.028597:0:16188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265613.028645:0:16188:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080decc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265613.028873:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553804672 00000100:00100000:2.0:1789265613.028884:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553804672 00000100:00100000:2.0:1789265613.028947:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265613.028958:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16188:x1876180553804672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789265613.029083:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16188:x1876180553804672:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265613.029091:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265613.029140:0:16188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9254377d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16188:1876180553804672:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789265613.030325:0:16188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1789265613.030472:0:16188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437063b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16188:1876180553804800:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789265613.030528:0:16188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265613.030561:0:16188:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080de840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265613.031086:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553804800 00000100:00100000:3.0:1789265613.031095:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553804800 00000100:00100000:3.0:1789265613.031149:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265613.031163:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16188:x1876180553804800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789265613.031429:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16188:x1876180553804800:12345-0@lo:1000:mdt00_003.0 Request processed in 267us (899us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789265613.031440:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265613.031510:0:16188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437063b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16188:1876180553804800:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789265613.031552:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031563:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031571:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031578:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265613.031591:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031602:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031618:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:0.0:1789265613.031621:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265613.031627:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031634:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b3c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031673:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031681:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031687:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031693:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441885800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265613.031695:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031702:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031711:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:0.0:1789265613.031713:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265613.031728:0:16188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190a9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f892f expref: 17 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031742:0:16188:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190a9b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f892f expref: 17 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031751:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190a9b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f892f expref: 17 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.031825:0:16188:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff925441885c00/0x8e12577ef8190a9b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f892f expref: 17 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265613.031840:0:16188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925437061880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16188:1876180553804928:192.168.204.43@tcp:105: 00000100:00100000:0.0:1789265613.032123:0:16188:0:(client.c:2715:ptlrpc_set_wait()) set ffff9254080de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265613.035479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265613.035851:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533901056 00000100:00100000:2.0:1789265613.035862:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533901056 00000100:00100000:2.0:1789265613.035934:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1789265613.035945:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+18:14516:x1876180533901056:12345-192.168.204.43@tcp:49:bash.0 00000100:00100000:2.0:1789265613.036095:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+18:14516:x1876180533901056:12345-192.168.204.43@tcp:49:bash.0 Request processed in 137us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265613.036095:0:16188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925437061880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16188:1876180553804928:192.168.204.43@tcp:105: 00000100:00100000:2.0:1789265613.036102:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00010000:00010000:0.0:1789265613.036121:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036132:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441885800/0x8e12577ef8190a94 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036164:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036176:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036188:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036217:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036223:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036229:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036235:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265613.036239:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036246:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036258:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:0.0:1789265613.036261:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265613.036265:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036270:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b43 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036281:0:16188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036287:0:16188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036292:0:16188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036313:0:16188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265613.036317:0:16188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036323:0:16188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036361:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:0.0:1789265613.036364:0:16188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265613.036367:0:16188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.036373:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b35 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16188 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265613.036681:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+17:14518:x1876180533900800:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 28993us (29959us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789265613.036690:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000020:00080000:2.0:1789265613.036695:0:16188:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265613.037097:0:14340:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789265613.037103:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265613.037151:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789265613.037159:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789265613.041317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265613.042462:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533901184 00000100:00100000:0.0:1789265613.042476:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533901184 00000100:00100000:2.0:1789265613.042644:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265613.042656:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+7:14516:x1876180533901184:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1789265613.042674:0:14993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265613.042703:0:14993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef8190b4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f8967 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265613.042980:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa606cb, atime: 0x6aa606c9, ctime: 0x6aa606cb, blocks: 0x1 00010000:00010000:2.0:1789265613.043005:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789265613.043010:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265613.043021:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef8190b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8967 expref: 8 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.043063:0:14993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d14dafb/0x8e12577ef8190b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f8967 expref: 8 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.043075:0:14993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92530677f600, rc 0) 00000100:00100000:2.0:1789265613.043175:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+8:14516:x1876180533901184:12345-192.168.204.43@tcp:101:bash.0 Request processed in 521us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265613.043182:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265613.044911:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265613.045021:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533901440 00000100:00100000:0.0:1789265613.045030:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533901440 00000100:00100000:0.0:1789265613.045122:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:0.0:1789265613.045132:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92542b3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+17:14518:x1876180533901440:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789265613.045942:0:14309:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789265613.046053:0:14309:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1789265613.046104:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.046132:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.046144:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.046152:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.046158:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.046164:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.046179:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789265613.046409:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92542b3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+19:14518:x1876180533901440:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 1275us (1502us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1789265613.046418:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000020:00080000:0.0:1789265613.046424:0:14309:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789265613.046575:0:14295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265613.046583:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.046592:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994800 already unused, calling callback (ffffffffc15cc350) 00010000:00010000:1.0:1789265613.046596:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.046605:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.046620:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92542b074400) 00010000:00010000:1.0:1789265613.046623:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265613.046628:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.046646:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b51 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.046661:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265613.046663:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265613.046665:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265613.048250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1789265613.050358:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533901696 00000100:00100000:3.0:1789265613.050372:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533901696 00000100:00100000:3.0:1789265613.050459:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:3.0:1789265613.050470:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+19:14516:x1876180533901696:12345-192.168.204.43@tcp:35:bash.0 00000001:00080000:3.0:1789265613.050786:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1789265613.052613:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1789265613.052958:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+22:14516:x1876180533901696:12345-192.168.204.43@tcp:35:bash.0 Request processed in 2483us (4711us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1789265613.052969:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000020:00080000:3.0:1789265613.052974:0:14310:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789265613.160107:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265613.160233:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533901952 00000100:00100000:0.0:1789265613.160243:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533901952 00000100:00100000:0.0:1789265613.160308:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:0.0:1789265613.160317:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+22:14528:x1876180533901952:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1789265613.160404:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265613.160426:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ce15db3881f896e expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265613.160527:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789265613.160637:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f896e expref: 24 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.160648:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925409ab9600) 00010000:00010000:0.0:1789265613.160650:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265613.160653:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x3ce15db3881f896e expref: 24 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.160665:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925441994800, rc 0) 00000100:00100000:0.0:1789265613.160717:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14528:x1876180533901952:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 402us (620us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1789265613.160724:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:2.0:1789265613.168567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265613.168731:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533902080 00000100:00100000:0.0:1789265613.168740:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533902080 00000100:00100000:0.0:1789265613.168803:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:0.0:1789265613.168814:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14528:x1876180533902080:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:0.0:1789265613.169041:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169059:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169070:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169084:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169090:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169111:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169508:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169522:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169530:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265613.169570:0:14308:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169582:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169589:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169594:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169600:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994800 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265613.169604:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169612:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169625:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff925409ab9a00) 00010000:00010000:0.0:1789265613.169643:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265613.169651:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169657:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994800/0x8e12577ef8190b66 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169671:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169676:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169682:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169686:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441995a00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265613.169689:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169695:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169704:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92542b074a00) 00010000:00010000:0.0:1789265613.169707:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265613.169709:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169715:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441995a00/0x8e12577ef8190b6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169730:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169742:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169748:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169930:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925441994e00 already unused, calling callback (ffffffffc1fdc4f0) 00010000:00010000:0.0:1789265613.169935:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169941:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169949:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925409ab9b00) 00010000:00010000:0.0:1789265613.169952:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265613.169955:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.169959:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925441994e00/0x8e12577ef8190b74 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265613.170111:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14528:x1876180533902080:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1296us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265613.170120:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:1.0:1789265613.177702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265613.178162:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533902336 00000100:00100000:0.0:1789265613.178178:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533902336 00000100:00100000:0.0:1789265613.178245:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1789265613.178261:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+23:14528:x1876180533902336:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1789265613.178575:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92540353ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+24:14528:x1876180533902336:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 316us (881us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1789265613.178598:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00010000:00010000:1.0:1789265613.470943:0:14294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265614.466172:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1789265614.466473:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533902464 00000100:00100000:1.0:1789265614.466487:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533902464 00000100:00100000:1.0:1789265614.466541:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:1.0:1789265614.466550:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:2345:x1876180533902464:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1789265614.466633:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4167d5b-7780-44cf-a6ba-cf4f934867bb+13:2345:x1876180533902464:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 83us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265614.466640:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:2.0:1789265614.472670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1789265614.475785:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533902592 00000100:00100000:0.0:1789265614.475822:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533902592 00000100:00100000:0.0:1789265614.475915:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:0.0:1789265614.475927:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+24:2345:x1876180533902592:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1789265614.477227:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+24:2345:x1876180533902592:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 1288us (4557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265614.477241:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:2.0:1789265614.483441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265614.483540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265614.483574:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265614.483613:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533902720 00000100:00100000:2.0:1789265614.483624:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533902720 00000100:00100000:2.0:1789265614.483704:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533902848 00000100:00100000:2.0:1789265614.483708:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533902848 00000100:00100000:2.0:1789265614.483731:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1789265614.483742:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2345:x1876180533902720:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265614.483829:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+5:2345:x1876180533902720:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 89us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265614.483836:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1789265614.483856:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:2.0:1789265614.483870:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+8:2345:x1876180533902848:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265614.483895:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+8:2345:x1876180533902848:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265614.483901:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:2.0:1789265614.483923:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533902976 00000100:00100000:2.0:1789265614.483926:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533902976 00000100:00100000:2.0:1789265614.483956:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:2.0:1789265614.483962:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2345:x1876180533902976:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265614.483992:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+6:2345:x1876180533902976:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265614.483998:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00080000:2.0:1789265614.484013:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265614.484017:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265614.484019:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265614.486221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265614.488365:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265614.488422:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533903104 00000100:00100000:2.0:1789265614.488433:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533903104 00000100:00100000:2.0:1789265614.488505:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533903232 00000100:00100000:2.0:1789265614.488508:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533903232 00000100:00100000:2.0:1789265614.488532:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265614.488542:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2345:x1876180533903104:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265614.488622:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2345:x1876180533903104:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 81us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265614.488631:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1789265614.488651:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1789265614.488675:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2345:x1876180533903232:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1789265614.488700:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b15b9fc8-a4f9-43f1-b72a-1e7d3adb63e8+5:2345:x1876180533903232:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265614.488706:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00080000:2.0:1789265614.488732:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265614.488736:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265614.495498:0:15927:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265614.837633:0:16576:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1789265615.263446:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553805184:0@lo:400:kworker.0 00000100:00100000:0.0:1789265615.263524:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92543b454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553805056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265615.263529:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265615.263558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265615.263583:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553805696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265615.263608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265615.263630:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789265615.263636:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553805312:0@lo:400:kworker.0 00000100:00100000:3.0:1789265615.263652:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540353f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553805440:0@lo:400:kworker.0 00000100:00100000:2.0:1789265615.263658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265615.263675:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553805824:0@lo:400:kworker.0 00000100:00100000:3.0:1789265615.263678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265615.263692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265615.263719:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553805312 00000100:00100000:2.0:1789265615.263726:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553805312 00000100:00100000:3.0:1789265615.263728:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553805440 00000100:00100000:3.0:1789265615.263730:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553805440 00000100:00100000:2.0:1789265615.263783:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265615.263793:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553805312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265615.263844:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876180553805312:12345-0@lo:400:kworker.0 Request processed in 53us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265615.263852:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789265615.263873:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265615.263903:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876180553805312:0@lo:400:kworker.0 00000100:00100000:1.0:1789265615.263968:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553805696 00000100:00100000:1.0:1789265615.263984:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553805696 00000100:00100000:1.0:1789265615.264016:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553805824 00000100:00100000:1.0:1789265615.264020:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553805824 00000100:00100000:1.0:1789265615.264041:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265615.264047:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553805696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265615.264085:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876180553805696:12345-0@lo:400:kworker.0 Request processed in 39us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265615.264092:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265615.264116:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265615.264122:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553805824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265615.264144:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876180553805824:12345-0@lo:400:kworker.0 Request processed in 23us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265615.264161:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789265615.264185:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265615.264204:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553805056 00000100:00100000:1.0:1789265615.264208:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553805056 00000100:00080000:3.0:1789265615.264255:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265615.264462:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265615.264469:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1876180553805056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265615.264498:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265615.264533:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1876180553805056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265615.264539:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265615.264560:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553805184 00000100:00100000:1.0:1789265615.264564:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553805184 00000100:00100000:1.0:1789265615.264588:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789265615.264593:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92530427bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553805184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265615.264623:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92530427bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c79c9cb-ef4c-488b-80e5-fba066317ec7+19:3304:x1876180553805184:12345-0@lo:400:kworker.0 Request processed in 30us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265615.266157:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876180553805824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265615.266187:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c79c9cb-ef4c-488b-80e5-fba066317ec7:3304:1876180553805184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265615.266198:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876180553805696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265615.267141:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553805952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265615.267218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265615.267313:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265615.267326:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925441a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553805440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265615.267416:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925441a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1876180553805440:12345-0@lo:400:kworker.0 Request processed in 94us (3736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265615.267424:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265615.267470:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540353f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553805440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265615.267741:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789265615.269029:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553805952 00000100:00100000:2.0:1789265615.269038:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553805952 00000100:00100000:0.0:1789265615.269045:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92543b454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876180553805056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265615.269057:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92540c338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553805568:0@lo:400:kworker.0 00000100:00100000:2.0:1789265615.269070:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265615.269077:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553805952:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265615.269104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265615.269139:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180553805568 00000100:00100000:0.0:1789265615.269143:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180553805568 00000100:00100000:0.0:1789265615.269173:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265615.269180:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925437062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553805568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265615.269223:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925437062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876180553805568:12345-0@lo:400:kworker.0 Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265615.269231:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265615.269261:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876180553805568:0@lo:400:kworker.0 00002000:00000024:2.0:1789265615.270222:0:14994:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265615.270390:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876180553805952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1311us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265615.270399:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265615.270454:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92540c339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876180553805952:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789265615.300101:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1789265615.300975:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1789265615.302063:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:0.0:1789265615.518600:0:15926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265616.098706:0:14340:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265616.098716:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265616.098750:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789265616.098756:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789265616.514354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265616.514403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1789265616.514440:0:15719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533903488 00000100:00100000:2.0:1789265616.514453:0:15719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533903488 00000100:00100000:2.0:1789265616.514518:0:15719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1789265616.514539:0:15719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2342:x1876180533903488:12345-192.168.204.43@tcp:16:kworker.0 00000100:00100000:2.0:1789265616.514666:0:15719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2342:x1876180533903488:12345-192.168.204.43@tcp:16:kworker.0 Request processed in 131us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265616.514674:0:15719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00080000:2.0:1789265616.514696:0:14302:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265616.518073:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180533903360 00000100:00100000:0.0:1789265616.518090:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180533903360 00002000:00100000:0.0:1789265616.518137:0:14996:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff92543b455c00 x1876180533903360/t0(0) o4->a1d40be9-5dee-4758-b282-460ebd8de52f@192.168.204.43@tcp:187/0 lens 504/0 e 0 to 0 dl 1789265627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789265616.518151:0:14996:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543b455c00 with x1876180533903360 ext(0->8) 00002000:00010000:0.0:1789265616.518157:0:14996:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92543b455c00 00000100:00100000:0.0:1789265616.518205:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:0.0:1789265616.518215:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92543b455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+6:2342:x1876180533903360:12345-192.168.204.43@tcp:4:bash.0 00000100:00100000:0.0:1789265616.519010:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92543b455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1d40be9-5dee-4758-b282-460ebd8de52f+8:2342:x1876180533903360:12345-192.168.204.43@tcp:4:bash.0 Request processed in 787us (4670us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789265616.519021:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00002000:00100000:0.0:1789265616.519030:0:14996:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff92543b455c00 x1876180533903360/t8589934598(0) o4->a1d40be9-5dee-4758-b282-460ebd8de52f@192.168.204.43@tcp:187/0 lens 504/448 e 0 to 0 dl 1789265627 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789265616.519039:0:14996:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92543b455c00 with x1876180533903360 ext(0->8) 00002000:00010000:0.0:1789265616.519043:0:14996:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92543b455c00 00010000:00010000:2.0:1789265616.545673:0:14295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29759 lines, 29759 kept, 0 dropped, 0 bad.